-- Logs begin at Fri 2021-02-19 01:40:48 UTC, end at Fri 2021-02-19 02:47:30 UTC. -- Feb 19 02:16:37.716242 dv-cinder-776422-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 19 02:16:37.723933 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 19 02:16:37.725934 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: *** Starting uWSGI 2.0.15-debian (64bit) on [Fri Feb 19 02:16:37 2021] *** Feb 19 02:16:37.725934 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Feb 19 02:16:37.725934 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Feb 19 02:16:37.725934 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: nodename: dv-cinder-776422-2-iscsi Feb 19 02:16:37.725934 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: machine: x86_64 Feb 19 02:16:37.725934 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: clock source: unix Feb 19 02:16:37.725934 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: pcre jit disabled Feb 19 02:16:37.725934 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: detected number of CPU cores: 4 Feb 19 02:16:37.725934 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: current working directory: / Feb 19 02:16:37.725934 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: detected binary path: /usr/bin/uwsgi-core Feb 19 02:16:37.725934 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: dropping root privileges as early as possible Feb 19 02:16:37.726940 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: your processes number limit is 47843 Feb 19 02:16:37.726940 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: your memory page size is 4096 bytes Feb 19 02:16:37.726940 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: detected max file descriptor number: 2048 Feb 19 02:16:37.726940 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: lock engine: pthread robust mutexes Feb 19 02:16:37.726940 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: thunder lock: enabled Feb 19 02:16:37.726940 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 19 02:16:37.726940 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: dropping root privileges after socket binding Feb 19 02:16:37.726940 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: Python version: 3.6.9 (default, Oct 8 2020, 12:12:24) [GCC 8.4.0] Feb 19 02:16:37.771215 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: Python main interpreter initialized at 0x55ff942ed9c0 Feb 19 02:16:37.771215 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: dropping root privileges after plugin initialization Feb 19 02:16:37.771215 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: python threads support enabled Feb 19 02:16:37.771215 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: your server socket listen backlog is limited to 100 connections Feb 19 02:16:37.771215 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: your mercy for graceful operations on workers is 90 seconds Feb 19 02:16:37.771677 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: mapped 402621 bytes (393 KB) for 2 cores Feb 19 02:16:37.771677 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: *** Operational MODE: preforking *** Feb 19 02:16:37.771849 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: dropping root privileges after application loading Feb 19 02:16:37.771849 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: *** uWSGI is running in multiple interpreter mode *** Feb 19 02:16:37.771849 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: spawned uWSGI master process (pid: 83320) Feb 19 02:16:37.772008 dv-cinder-776422-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 19 02:16:37.773235 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: spawned uWSGI worker 1 (pid: 83321, cores: 1) Feb 19 02:16:37.773235 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: spawned uWSGI worker 2 (pid: 83322, cores: 1) Feb 19 02:16:37.773235 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 19 02:16:42.307196 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Feb 19 02:16:42.307750 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Feb 19 02:16:42.307829 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Feb 19 02:16:42.308059 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Feb 19 02:16:42.308969 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Feb 19 02:16:42.309406 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Feb 19 02:16:42.309622 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Feb 19 02:16:42.309738 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Feb 19 02:16:42.310052 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Feb 19 02:16:42.310148 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.310340 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Feb 19 02:16:42.310483 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.310836 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.310976 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.311191 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.311316 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.311575 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.311688 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.311928 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.312025 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.312295 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.312400 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.312637 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.312733 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.313001 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.313103 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.313290 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.313396 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.313648 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.313753 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.313961 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.314057 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-776422-2-iscsi {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.314311 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.314447 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.314703 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-776422-2-iscsi {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.314801 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.315047 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.315143 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.315380 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.315483 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.315725 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.315828 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.316083 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.316186 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.316436 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.316569 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.316771 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.317038 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.317152 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.317386 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.317697 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.317814 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.318043 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.318161 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.318398 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.318499 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.318743 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.318848 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.319088 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.319185 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.319444 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.319565 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.319786 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.319943 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.320137 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.320281 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.320765 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.320919 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.321127 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-776422-2-iscsi {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.321273 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.321463 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.321615 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.321818 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.321961 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-776422-2-iscsi {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.322157 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.322307 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.322552 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.322718 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.322902 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.323046 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.323301 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.323445 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.323668 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.323822 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.324012 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.324174 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.324321 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.324462 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.324699 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.324849 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.325031 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.325182 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.325396 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.325550 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.325746 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.325896 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.326043 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.326186 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.326407 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.326565 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.326761 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.326917 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.327094 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.327239 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.327437 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.327581 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.327771 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.327923 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.328182 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.328330 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.328469 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.328612 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.328749 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.328893 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.329030 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.329207 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.329349 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.329488 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.329643 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.329793 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.329936 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.330082 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.330255 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.330414 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.330558 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.330696 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.330909 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.331066 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.331255 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.331456 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.331594 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.331729 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.331933 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.332072 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.332209 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.332345 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.332487 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.332624 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.332831 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.332982 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.333177 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.333342 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.333519 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.333664 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.333861 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.334005 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.334215 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.334383 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.334588 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.334741 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.334944 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.335090 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.335278 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.335422 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.335636 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.335791 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.335974 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.336119 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.336373 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.336519 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.336717 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.336868 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.337063 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.337208 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.337425 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.337570 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.337760 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.337925 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.338105 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.338334 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.338539 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.338678 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.338815 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.338963 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.339108 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.339249 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.339386 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.339527 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.339751 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.339908 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.340063 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.340200 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.340342 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.340493 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.340639 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.340775 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.340977 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.341128 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.341306 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.341450 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.341649 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.341800 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.341979 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.342134 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.342310 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.342490 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.342683 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.342834 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.343029 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.343180 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.343376 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.343520 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.343721 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.343874 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.344018 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.344155 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.344363 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.344514 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.344699 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.344849 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.345028 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.345173 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.345358 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.345515 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.345659 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.345804 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.345998 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.346143 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.346376 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.346547 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.346685 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.346821 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.347031 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.347177 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.347375 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.347538 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.347723 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.347872 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.348059 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.348205 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.348427 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.348585 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.348732 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.348868 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.349005 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.349147 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.349364 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.349511 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.349704 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.349855 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.350039 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.350193 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.350449 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.350600 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.350746 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.350884 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.351057 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.351207 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.351394 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.351546 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.352250 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.352404 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.352593 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.352743 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.352897 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.353040 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.353236 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.353395 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.353544 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.353692 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.353886 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.354036 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.354178 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.354325 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.354514 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.354669 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.354850 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.355007 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.355151 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.355298 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.355491 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.355651 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.355795 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.355935 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.356150 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.356299 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.356486 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.356650 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.356792 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.356933 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.357130 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.357292 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.357441 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.357598 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.357794 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:16:42.357946 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.358180 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.358340 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.358628 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.358779 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.358922 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.359064 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.359261 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.359412 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.359622 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.359785 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.359977 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.360126 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.360325 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.360476 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.360675 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.360827 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.361018 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.361173 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.361370 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.361533 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.361677 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.361828 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.362024 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.362181 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.362395 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.362565 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.362752 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.362909 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.363101 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.363251 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.363460 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.363677 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.363829 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.363993 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.364153 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.364315 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.364458 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.364605 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.364747 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.364889 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.365089 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.365252 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.365457 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.365609 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.365815 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.365965 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.366161 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.366324 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.366520 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.366674 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.366895 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.367046 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.367263 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.368000 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.368193 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.368345 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.368545 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.368780 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.368936 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.369085 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.369253 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.369401 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.369550 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.369702 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.369852 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.369999 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.370186 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.370347 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.370592 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.370737 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.370879 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.371020 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.371228 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.371400 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.371546 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.371687 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.371889 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.372040 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.372188 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.372339 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.372536 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.372687 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.372840 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.372983 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.373192 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.373350 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.373542 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.373698 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.373879 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.374029 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.374257 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.374460 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.374613 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.374755 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.374942 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.375092 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.375291 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.375452 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.375635 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.375802 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.375946 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.376087 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.376282 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.376433 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.376615 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.376765 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.376954 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.377110 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.377264 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.377407 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.377618 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.377776 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.377934 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.378081 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.378270 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.378460 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.378660 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.378903 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.379054 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.379197 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.379346 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.379487 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.379629 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.379776 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.379926 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.380076 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.380270 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.380432 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.380618 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.380770 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.380960 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.381118 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.381304 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.381455 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.381650 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.381802 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.382018 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.382188 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.382408 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.382536 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.382757 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.382860 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.383152 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.383273 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.383491 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.383606 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.383843 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.383942 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.384172 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.384278 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.384511 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.384619 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.384841 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.384939 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.385179 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.385282 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.385509 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.385605 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.385843 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.385939 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.386172 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.386270 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.386532 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.386630 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.386863 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.386963 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.387202 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.387300 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.387541 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.387643 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.387877 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.387974 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.388218 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.388315 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.388552 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.388653 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.388883 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.388964 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.389222 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.389319 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.389608 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.389712 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.389951 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.390058 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.390307 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.390427 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.390694 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.390803 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.391042 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.391150 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.391388 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.391493 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.391736 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.391844 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.392067 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.392175 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.392410 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.392505 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.392749 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.392846 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.393100 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.393204 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.393439 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.393548 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.393780 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.393877 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.394111 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.394214 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.394502 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.394598 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.394840 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.394937 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.395192 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.395289 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.395528 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.395623 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.395875 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.395971 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.396219 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.396320 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.396557 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.396652 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.396895 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.396990 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.397231 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.397334 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.397574 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.397669 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.397905 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.398000 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.398250 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.398365 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.399143 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.399245 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.399484 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.399590 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.399822 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.399917 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.400164 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.400260 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.400501 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.400603 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.400838 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.400940 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.401179 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.401279 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.401518 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.401625 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.401863 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.401971 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.402214 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.402311 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.402608 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.402717 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.402954 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.403051 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.403297 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.403396 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.403636 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.403740 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.403977 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.404073 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.404313 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.404409 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.404658 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.404756 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.404989 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.405085 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.405329 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.405431 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.405670 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.405767 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.406009 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.406107 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.406378 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.406478 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.406726 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.406823 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.407081 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.407176 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.407429 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.407525 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.407766 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.407872 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.408106 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.408201 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.408444 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.408547 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.408790 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.408886 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.409127 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.409208 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.409475 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.409578 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.409815 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.409911 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.410155 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.410252 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.410521 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.410632 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.410866 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.410955 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.411209 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.411311 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.411551 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.411653 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.411896 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.412006 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.412237 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.412335 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.412574 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.412679 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.412912 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.413012 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.413258 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.413595 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.413710 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.413963 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.414874 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.415380 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.415380 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.415796 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.416133 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.416364 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.416476 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.416634 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.416634 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.416825 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.416930 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.417027 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.417120 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.417213 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.417213 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.417393 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.417542 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.417642 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.417875 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.417979 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.418211 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.418323 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.418571 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.418681 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.418912 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.419033 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.419247 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.419414 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.419582 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.419686 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.419925 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.420031 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.420255 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.420367 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.420598 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.420698 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.420942 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.421042 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.421286 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.421393 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.421637 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.421988 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.422099 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.422341 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.422538 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.422670 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.422898 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.423042 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.423243 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.423389 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.423595 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.423732 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.423944 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.424043 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.424309 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.424407 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.424655 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.424755 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.424998 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.425096 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.425339 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.425437 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.425678 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.425777 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.426066 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.426165 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.426425 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.426525 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.426808 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.426914 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.427174 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.427273 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.427509 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.427616 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.427851 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.427952 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.428183 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.428281 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.428523 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.428633 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.428857 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.428962 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.429195 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.429294 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.429542 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.429653 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.429903 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.430007 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.430234 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.430339 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.430602 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.430710 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.430949 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.431047 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.431284 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.431382 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.431621 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.431726 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.431957 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.432075 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.432296 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.432406 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.432635 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.432734 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.432975 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.433072 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.433304 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.433403 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.433639 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.433738 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.433985 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.434074 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.434318 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.434440 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.434680 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.434780 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.435015 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.435098 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.435358 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.435457 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.435685 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.435785 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.436029 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.436127 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.436370 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.436480 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.436703 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.436801 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.437038 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.437137 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.437374 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.437484 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.437719 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.437817 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.438048 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.438146 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.438405 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.438532 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.438743 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.438846 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.439075 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.439175 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.439406 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.439501 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.439740 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.439839 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.440066 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.440164 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.440404 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.440510 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.440740 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.440844 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.441074 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.441172 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.441403 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.441502 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.441738 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.441836 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.442078 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.442177 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.442439 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.442551 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.442779 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.442889 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.443115 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.443213 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.443495 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.443594 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.443832 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.443936 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.444186 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.444290 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.444530 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.444628 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.444871 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.444969 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.445217 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.445315 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.445847 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.445952 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.446180 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.446277 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.446552 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.446663 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.446890 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.446989 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.447238 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.447336 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.447567 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.447692 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.447905 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.448009 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.448263 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.448362 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.448598 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.448707 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.448942 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.449041 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.449279 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.449377 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.449632 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.449738 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.449981 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.450081 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.450309 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.450455 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.450678 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.450789 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.451019 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.451119 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.451353 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.451450 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.451694 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.451794 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.452052 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.452175 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.452402 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.452513 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.452742 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.452842 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.453081 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.453188 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.453418 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.453517 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.453751 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.453850 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.454086 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.454185 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.454460 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.454573 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.454807 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.454912 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.455137 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.455242 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.455473 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.455579 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.455812 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.455918 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.456147 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.456245 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.456480 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.456638 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.456819 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.456989 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.457165 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.457339 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.457502 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.457684 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.457982 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.458080 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.458329 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.458456 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.458699 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.458839 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.459045 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.459178 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.459377 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.459506 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.459713 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.459845 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.460066 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.460174 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.460415 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.460525 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.460754 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.460868 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.461670 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.461791 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.462020 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.462127 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.462403 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.462511 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.462754 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.462862 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.463089 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.463193 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.463418 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.463518 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.463752 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.463856 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.464109 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.464207 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.464445 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.464544 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.464772 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.464870 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.465110 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.465257 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.465471 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.465610 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.465810 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.465954 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.466169 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.466452 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.466684 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.466784 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.467029 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.467126 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.467423 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.467536 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.467802 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.467901 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.468172 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.468276 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.468514 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.468637 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.468870 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.468967 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.469209 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.469314 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.469569 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.469668 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.469910 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.470007 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.470250 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.470349 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.470612 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.470712 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.470953 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.471052 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.471312 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.471409 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.471660 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.471758 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.472011 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.472115 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.472343 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.472441 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.472710 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.472980 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.473078 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.473355 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.473483 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.473710 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.473826 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.474080 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.474326 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.474473 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.474715 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.474827 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.475072 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.475187 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.475429 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.475521 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.475761 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.475872 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.476107 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.476206 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.476446 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.476547 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.477379 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.477503 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.477757 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.477864 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.478093 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.478200 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.478461 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.478586 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.478805 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.478904 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.479142 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.479269 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.479489 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.479616 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.479826 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.479959 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.480158 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.480291 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.480492 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.480592 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.480851 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.480950 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.481189 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.481293 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.481525 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.481624 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.481872 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.481969 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.482219 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.482324 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.482892 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.483363 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.483363 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.483509 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.483509 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.483669 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.483669 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.483852 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.484177 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.484516 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.484599 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.484859 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.484958 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.485212 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.485313 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.485568 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.485673 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.485937 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.486037 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.486291 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.486463 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.486673 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.486771 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.487049 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.487148 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.487400 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.487497 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.487748 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.487845 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.488103 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.488202 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.488440 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.488538 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.488781 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.488872 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.489121 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.489218 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.489455 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.489561 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.489785 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.489884 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.490123 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.490229 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.490490 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.490592 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.490829 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.490928 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.491165 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.491275 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.491492 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.491590 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.491828 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.491933 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.492167 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.492279 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.492527 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.492626 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.492887 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.492993 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.493223 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.493329 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.493557 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.493655 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.493891 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.493990 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.494229 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.494328 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.494624 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.494717 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.494956 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.495055 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.495329 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.495429 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.495681 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.495778 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.496037 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.496144 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.496377 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.496476 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.496721 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.496819 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.497081 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.497192 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.497425 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.497531 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.497775 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.497874 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.498119 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.498219 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.498495 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.498598 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.498858 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.498969 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.499215 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.499322 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.499565 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.499670 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.499901 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.499999 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.500250 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.500350 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.500592 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.500690 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.500944 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.501187 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.501541 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.501646 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.501905 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.502009 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.502256 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.502377 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.502627 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.502725 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.502975 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.503074 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.503323 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.503429 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.503672 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.503770 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.504011 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.504109 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.504356 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.504464 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.504693 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.504828 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.505036 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.505136 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.505371 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.505478 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.505736 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.505869 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.506100 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.506199 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.506508 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.506613 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.506873 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.506972 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.507218 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.507319 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.507565 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.507666 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.507925 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.508033 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.508282 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.508389 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.508678 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.508779 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.509025 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.509124 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.509367 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.509478 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.509722 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.509822 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.510070 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.510170 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.510443 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.510556 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.510804 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.510933 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.511151 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.511251 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.511490 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.511591 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.511839 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.511938 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.512181 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.512280 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.512525 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.512625 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.512875 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.512981 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.513223 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.513329 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.513599 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.513725 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.513951 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.514056 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.514451 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.514580 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.514679 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.514774 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.515028 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.515134 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.515411 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.515616 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.515971 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.516071 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.516317 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.516416 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.516687 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.516794 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.517045 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.517149 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.517392 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.517492 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.517734 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.517834 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.518078 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.518177 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.518449 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.518552 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.518786 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.518893 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.519125 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.519225 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.519466 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.519573 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.519801 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.519902 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.520138 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.520237 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.520476 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.520575 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.520810 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.520922 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.521148 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.521249 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.521488 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.521588 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.521823 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.522111 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.522457 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.522558 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.522858 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.522965 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.523211 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.523311 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.524105 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.524213 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.524465 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.524575 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.524808 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.524908 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.525151 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.525251 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.525489 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.525595 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.525829 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.525927 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.526172 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.526274 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.526552 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.526666 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.526892 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.526998 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.527226 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.527326 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.527558 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.527665 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.527896 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.528001 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.528229 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.528334 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.528568 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.528668 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.528901 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.529001 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.529236 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.529336 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.529577 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.529677 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.529921 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.530025 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.530267 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.530385 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.530640 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.530741 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.530977 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.531076 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.531307 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.531413 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.531640 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.531740 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.531974 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.532081 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.532307 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.532418 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.532644 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.532747 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.532973 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.533080 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.533316 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.533434 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.533644 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.533727 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.533982 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.534094 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.534311 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.534512 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.534677 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.534813 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.535005 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.535095 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.535363 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.535665 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.535665 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.535888 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.536001 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.536134 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.536351 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.536453 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.536694 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.536814 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.537038 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.537169 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.537376 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.537476 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.537721 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.537855 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.538093 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.538209 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.538464 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.538727 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.539061 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.539239 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.539494 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.539589 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.539856 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.539966 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.540234 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.540342 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.540584 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.540672 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.540922 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.541036 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.541255 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.541360 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.541587 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.541705 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.541943 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.542051 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.542280 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.542408 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.542650 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.542752 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.542992 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.543088 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.543329 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.543449 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.543673 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.543864 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.544015 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.544143 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.544357 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.544498 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.544692 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.544802 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.545032 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.545134 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.545365 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.545472 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.545750 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.545850 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.546112 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.546211 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.546493 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.546597 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.546859 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.546960 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.547201 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.547315 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.547544 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.547650 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.547880 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.547981 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.548224 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.548323 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.548563 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.548663 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.548917 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.549019 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.549261 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.549361 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.549608 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.549717 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.549936 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.550089 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.550443 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.550560 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.550795 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.550903 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.551148 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.551248 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.551490 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.551595 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.551827 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.551993 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.552197 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.552297 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.552576 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.552678 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.552941 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.553042 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.553294 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.553393 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.553626 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.553727 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.553962 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.554063 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.554291 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.554421 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.554660 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.555279 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.555568 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.555670 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.555924 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.556024 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.556275 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.556423 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.556639 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.556759 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.556988 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.557089 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.557376 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.557515 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.557678 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.557805 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.558015 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.558116 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.558379 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.558519 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.558724 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.558825 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.559090 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.559199 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.559440 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.559561 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.559786 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.559888 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.560136 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.560245 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.560480 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.560597 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.560817 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.560918 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.561157 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.561263 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.561515 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.561616 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.561869 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.561984 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.562206 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.562310 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.562581 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.562685 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.562932 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.563037 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.563281 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.563381 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.563626 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.563733 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.563963 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.564063 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.564315 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.564415 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.564650 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.564751 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.565011 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.565117 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.565358 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.565489 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.565701 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.565805 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.566043 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.566143 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.566408 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.566575 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.566764 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.566870 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.567105 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.567204 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.567446 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.567553 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.567781 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.567888 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.568123 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.568223 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.568457 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.568569 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.568821 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.568921 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.569157 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.569256 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.569497 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.569598 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.569856 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.569956 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.570199 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.570299 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.571394 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.571510 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.571751 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.571851 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.572098 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.572197 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.572446 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.572546 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.572788 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.572888 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.573134 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.573241 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.573472 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.573571 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.573816 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.573920 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.574168 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.574275 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.574549 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.574652 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.574910 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.575010 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.575267 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.575379 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.575630 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.575779 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.575989 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.576090 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.576354 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.576462 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.576717 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.576822 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.577093 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.577200 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.577372 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83322) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Feb 19 02:16:42.577473 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:16:42.577740 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=83321) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Feb 19 02:16:42.612824 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG oslo_db.sqlalchemy.engines [None req-29a5e547-c605-42fb-b96f-9ee8ba365007 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83322) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 19 02:16:42.615718 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG oslo_db.sqlalchemy.engines [None req-091fc027-9133-4ff2-a87f-56de8dc5d8e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83321) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 19 02:16:42.872033 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.context [None req-29a5e547-c605-42fb-b96f-9ee8ba365007 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8(cell1) {{(pid=83322) load_cells /opt/stack/nova/nova/context.py:466}} Feb 19 02:16:42.879122 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG oslo_concurrency.lockutils [None req-29a5e547-c605-42fb-b96f-9ee8ba365007 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83322) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:16:42.880950 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG oslo_concurrency.lockutils [None req-29a5e547-c605-42fb-b96f-9ee8ba365007 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83322) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:16:42.881822 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG oslo_concurrency.lockutils [None req-29a5e547-c605-42fb-b96f-9ee8ba365007 None None] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83322) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:16:42.884000 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG oslo_concurrency.lockutils [None req-29a5e547-c605-42fb-b96f-9ee8ba365007 None None] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83322) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:16:42.889529 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.context [None req-091fc027-9133-4ff2-a87f-56de8dc5d8e2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8(cell1) {{(pid=83321) load_cells /opt/stack/nova/nova/context.py:466}} Feb 19 02:16:42.896889 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG oslo_concurrency.lockutils [None req-091fc027-9133-4ff2-a87f-56de8dc5d8e2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83321) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:16:42.898853 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG oslo_concurrency.lockutils [None req-091fc027-9133-4ff2-a87f-56de8dc5d8e2 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83321) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:16:42.899751 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG oslo_concurrency.lockutils [None req-091fc027-9133-4ff2-a87f-56de8dc5d8e2 None None] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83321) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:16:42.901884 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG oslo_concurrency.lockutils [None req-091fc027-9133-4ff2-a87f-56de8dc5d8e2 None None] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=83321) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:16:42.905827 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG oslo_db.sqlalchemy.engines [None req-29a5e547-c605-42fb-b96f-9ee8ba365007 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83322) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 19 02:16:42.912657 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG oslo_db.sqlalchemy.engines [None req-29a5e547-c605-42fb-b96f-9ee8ba365007 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83322) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 19 02:16:42.935711 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG oslo_db.sqlalchemy.engines [None req-091fc027-9133-4ff2-a87f-56de8dc5d8e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83321) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 19 02:16:42.943639 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG oslo_db.sqlalchemy.engines [None req-091fc027-9133-4ff2-a87f-56de8dc5d8e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83321) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 19 02:16:42.948169 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG oslo_db.sqlalchemy.engines [None req-29a5e547-c605-42fb-b96f-9ee8ba365007 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83322) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 19 02:16:42.973325 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG oslo_db.sqlalchemy.engines [None req-091fc027-9133-4ff2-a87f-56de8dc5d8e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=83321) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 19 02:16:43.045662 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 19 02:16:43.045662 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: from cryptography.utils import int_from_bytes Feb 19 02:16:43.046058 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 19 02:16:43.046058 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: from cryptography.utils import int_from_bytes Feb 19 02:16:43.065641 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 19 02:16:43.065641 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: from cryptography.utils import int_from_bytes Feb 19 02:16:43.066032 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 19 02:16:43.066032 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: from cryptography.utils import int_from_bytes Feb 19 02:16:43.123399 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO keyring.backend [None req-29a5e547-c605-42fb-b96f-9ee8ba365007 None None] Loading Gnome Feb 19 02:16:43.143175 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO keyring.backend [None req-091fc027-9133-4ff2-a87f-56de8dc5d8e2 None None] Loading Gnome Feb 19 02:16:43.143661 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO keyring.backend [None req-29a5e547-c605-42fb-b96f-9ee8ba365007 None None] Loading Google Feb 19 02:16:43.147176 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO keyring.backend [None req-29a5e547-c605-42fb-b96f-9ee8ba365007 None None] Loading Windows (alt) Feb 19 02:16:43.152289 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO keyring.backend [None req-29a5e547-c605-42fb-b96f-9ee8ba365007 None None] Loading file Feb 19 02:16:43.153554 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO keyring.backend [None req-29a5e547-c605-42fb-b96f-9ee8ba365007 None None] Loading keyczar Feb 19 02:16:43.154004 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO keyring.backend [None req-29a5e547-c605-42fb-b96f-9ee8ba365007 None None] Loading multi Feb 19 02:16:43.154902 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO keyring.backend [None req-29a5e547-c605-42fb-b96f-9ee8ba365007 None None] Loading pyfs Feb 19 02:16:43.164067 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO keyring.backend [None req-091fc027-9133-4ff2-a87f-56de8dc5d8e2 None None] Loading Google Feb 19 02:16:43.167942 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO keyring.backend [None req-091fc027-9133-4ff2-a87f-56de8dc5d8e2 None None] Loading Windows (alt) Feb 19 02:16:43.172645 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO keyring.backend [None req-091fc027-9133-4ff2-a87f-56de8dc5d8e2 None None] Loading file Feb 19 02:16:43.173754 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO keyring.backend [None req-091fc027-9133-4ff2-a87f-56de8dc5d8e2 None None] Loading keyczar Feb 19 02:16:43.174205 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO keyring.backend [None req-091fc027-9133-4ff2-a87f-56de8dc5d8e2 None None] Loading multi Feb 19 02:16:43.175110 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO keyring.backend [None req-091fc027-9133-4ff2-a87f-56de8dc5d8e2 None None] Loading pyfs Feb 19 02:16:43.434674 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: WARNING keystonemiddleware.auth_token [None req-29a5e547-c605-42fb-b96f-9ee8ba365007 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 19 02:16:43.443289 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: WARNING keystonemiddleware.auth_token [None req-29a5e547-c605-42fb-b96f-9ee8ba365007 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 19 02:16:43.458003 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: WARNING keystonemiddleware.auth_token [None req-091fc027-9133-4ff2-a87f-56de8dc5d8e2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 19 02:16:43.465759 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: WARNING keystonemiddleware.auth_token [None req-091fc027-9133-4ff2-a87f-56de8dc5d8e2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 19 02:16:43.776468 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: WARNING keystonemiddleware.auth_token [None req-29a5e547-c605-42fb-b96f-9ee8ba365007 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 19 02:16:43.782103 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: WARNING keystonemiddleware.auth_token [None req-29a5e547-c605-42fb-b96f-9ee8ba365007 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 19 02:16:43.787621 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ff942ed9c0 pid: 83322 (default app) Feb 19 02:16:43.790393 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-29a5e547-c605-42fb-b96f-9ee8ba365007 None None] Calling method '>' {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:16:43.791584 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-29a5e547-c605-42fb-b96f-9ee8ba365007 None None] 10.222.0.44 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002347 Feb 19 02:16:43.792025 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 779 bytes} [Fri Feb 19 02:16:43 2021] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:16:43.807692 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: WARNING keystonemiddleware.auth_token [None req-091fc027-9133-4ff2-a87f-56de8dc5d8e2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 19 02:16:43.813390 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: WARNING keystonemiddleware.auth_token [None req-091fc027-9133-4ff2-a87f-56de8dc5d8e2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 19 02:16:43.818922 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ff942ed9c0 pid: 83321 (default app) Feb 19 02:18:09.980128 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-7c8b9bcf-ee9f-4832-9b53-6452be47b13f admin admin] Calling method '>' {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:18:10.005581 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-7c8b9bcf-ee9f-4832-9b53-6452be47b13f admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 15 microversion: 2.1 time: 0.502800 Feb 19 02:18:10.006834 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 2/2] 10.222.0.44 () {58 vars in 1150 bytes} [Fri Feb 19 02:18:09 2021] GET /compute/v2.1/flavors/detail => generated 15 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:18:12.890452 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-dc9f0504-3a19-47fc-aebd-3c3ed15b7587 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "vcpus": 1, "disk": 1, "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:18:12.916139 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:18:12.916139 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: warnings.warn(msg) Feb 19 02:18:12.944919 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-dc9f0504-3a19-47fc-aebd-3c3ed15b7587 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 367 microversion: 2.1 time: 0.398285 Feb 19 02:18:12.945515 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 1/3] 10.222.0.44 () {62 vars in 1183 bytes} [Fri Feb 19 02:18:12 2021] POST /compute/v2.1/flavors => generated 367 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:18:12.957353 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-c05f3fa6-9095-4c2a-b13d-4232189966bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:18:12.960197 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:18:12.960197 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: warnings.warn(msg) Feb 19 02:18:12.997533 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-c05f3fa6-9095-4c2a-b13d-4232189966bb admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.044384 Feb 19 02:18:12.998174 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 3/4] 10.222.0.44 () {62 vars in 1236 bytes} [Fri Feb 19 02:18:12 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 19 02:18:13.009411 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-7755eef1-7ffe-4228-a980-ffdd277d9eb4 admin admin] Calling method '>' {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:18:13.027853 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-7755eef1-7ffe-4228-a980-ffdd277d9eb4 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.023059 Feb 19 02:18:13.028578 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 2/5] 10.222.0.44 () {58 vars in 1183 bytes} [Fri Feb 19 02:18:13 2021] GET /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:18:15.625344 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-24de6140-d9ec-446e-87ae-3827d70d579a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "ram": 512, "vcpus": 1, "disk": 5, "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:18:15.649127 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:18:15.649127 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: warnings.warn(msg) Feb 19 02:18:15.671397 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-24de6140-d9ec-446e-87ae-3827d70d579a admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.100639 Feb 19 02:18:15.672031 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 4/6] 10.222.0.44 () {62 vars in 1183 bytes} [Fri Feb 19 02:18:15 2021] POST /compute/v2.1/flavors => generated 364 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:18:15.683561 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-42a57697-1d0c-4f5f-8acb-6abe19b559e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:18:15.685238 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:18:15.685238 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: warnings.warn(msg) Feb 19 02:18:15.722453 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-42a57697-1d0c-4f5f-8acb-6abe19b559e0 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.042696 Feb 19 02:18:15.723025 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 3/7] 10.222.0.44 () {62 vars in 1236 bytes} [Fri Feb 19 02:18:15 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:18:15.733421 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-a7b0bbae-cde6-477d-99d6-cdbb63447eb2 admin admin] Calling method '>' {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:18:15.749296 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-a7b0bbae-cde6-477d-99d6-cdbb63447eb2 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019880 Feb 19 02:18:15.749886 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 5/8] 10.222.0.44 () {58 vars in 1183 bytes} [Fri Feb 19 02:18:15 2021] GET /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:18:18.352976 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-39ca96d6-374b-45b2-8b77-c8236a2cf365 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "vcpus": 1, "disk": 10, "id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:18:18.375292 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-39ca96d6-374b-45b2-8b77-c8236a2cf365 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.077496 Feb 19 02:18:18.375907 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 4/9] 10.222.0.44 () {62 vars in 1183 bytes} [Fri Feb 19 02:18:18 2021] POST /compute/v2.1/flavors => generated 364 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:18:18.387100 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-e1d3edc2-a20f-498d-b118-842599dcaf7b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:18:18.424328 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-e1d3edc2-a20f-498d-b118-842599dcaf7b admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.041055 Feb 19 02:18:18.425009 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 6/10] 10.222.0.44 () {62 vars in 1236 bytes} [Fri Feb 19 02:18:18 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:18:18.435528 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-eada2dfc-e8bf-4d1d-bc5c-cc90671badfd admin admin] Calling method '>' {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:18:18.451770 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-eada2dfc-e8bf-4d1d-bc5c-cc90671badfd admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.020232 Feb 19 02:18:18.452842 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 5/11] 10.222.0.44 () {58 vars in 1183 bytes} [Fri Feb 19 02:18:18 2021] GET /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:18:21.083467 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-7c918f22-79b4-45a6-b947-885bbee5e0fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "vcpus": 2, "disk": 10, "id": "d3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:18:21.106064 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-7c918f22-79b4-45a6-b947-885bbee5e0fd admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.076921 Feb 19 02:18:21.106633 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 7/12] 10.222.0.44 () {62 vars in 1183 bytes} [Fri Feb 19 02:18:21 2021] POST /compute/v2.1/flavors => generated 364 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:18:21.117601 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-dcf60e53-5357-42d8-9247-3456644f7004 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:18:21.159923 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-dcf60e53-5357-42d8-9247-3456644f7004 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.046276 Feb 19 02:18:21.160559 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 6/13] 10.222.0.44 () {62 vars in 1236 bytes} [Fri Feb 19 02:18:21 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:18:21.170743 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-6be787cc-4bd3-44f0-937c-418a7e3c01cc admin admin] Calling method '>' {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:18:21.186126 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-6be787cc-4bd3-44f0-937c-418a7e3c01cc admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019311 Feb 19 02:18:21.186829 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 8/14] 10.222.0.44 () {58 vars in 1183 bytes} [Fri Feb 19 02:18:21 2021] GET /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:18:23.787041 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-51bdf72a-5324-4816-8cb4-ae8e1f53d319 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "vcpus": 4, "disk": 20, "id": "d4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:18:23.815140 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-51bdf72a-5324-4816-8cb4-ae8e1f53d319 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 364 microversion: 2.1 time: 0.086527 Feb 19 02:18:23.815781 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 7/15] 10.222.0.44 () {62 vars in 1183 bytes} [Fri Feb 19 02:18:23 2021] POST /compute/v2.1/flavors => generated 364 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:18:23.827682 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-da769603-9dc3-4016-976f-37c0cd2852f8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:18:23.863152 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-da769603-9dc3-4016-976f-37c0cd2852f8 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.039301 Feb 19 02:18:23.863710 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 9/16] 10.222.0.44 () {62 vars in 1236 bytes} [Fri Feb 19 02:18:23 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:18:23.874783 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-b41ac572-7b3a-4378-8a7a-410eca4fa837 admin admin] Calling method '>' {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:18:23.890768 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-b41ac572-7b3a-4378-8a7a-410eca4fa837 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.019832 Feb 19 02:18:23.891362 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 8/17] 10.222.0.44 () {58 vars in 1183 bytes} [Fri Feb 19 02:18:23 2021] GET /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:18:27.011305 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-6638d0bd-64d2-4f3d-bc35-04b7c564f0ec admin admin] Calling method '>' {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:18:27.031226 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-6638d0bd-64d2-4f3d-bc35-04b7c564f0ec admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 1786 microversion: 2.1 time: 0.076418 Feb 19 02:18:27.031834 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 10/18] 10.222.0.44 () {58 vars in 1150 bytes} [Fri Feb 19 02:18:26 2021] GET /compute/v2.1/flavors/detail => generated 1786 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:18:29.626694 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-23cff2ea-d218-4b9c-8c39-a4b66286f717 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "vcpus": 1, "disk": 1, "id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:18:29.649760 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-23cff2ea-d218-4b9c-8c39-a4b66286f717 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 362 microversion: 2.1 time: 0.077766 Feb 19 02:18:29.650407 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 9/19] 10.222.0.44 () {62 vars in 1183 bytes} [Fri Feb 19 02:18:29 2021] POST /compute/v2.1/flavors => generated 362 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:18:29.661230 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-fd9018b3-5bc3-4ed7-80dd-f47ee086aa5f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:18:29.698493 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-fd9018b3-5bc3-4ed7-80dd-f47ee086aa5f admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.040980 Feb 19 02:18:29.699262 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 11/20] 10.222.0.44 () {62 vars in 1233 bytes} [Fri Feb 19 02:18:29 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:18:29.709871 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-54250ee5-0508-4339-91f0-243fa00c533e admin admin] Calling method '>' {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:18:29.725780 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-54250ee5-0508-4339-91f0-243fa00c533e admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.020251 Feb 19 02:18:29.726370 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 10/21] 10.222.0.44 () {58 vars in 1180 bytes} [Fri Feb 19 02:18:29 2021] GET /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:18:32.362110 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-d7fb51a9-a335-4320-a92d-040048e2d55e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "ram": 2048, "vcpus": 1, "disk": 20, "id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:18:32.385542 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-d7fb51a9-a335-4320-a92d-040048e2d55e admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.080558 Feb 19 02:18:32.386165 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 12/22] 10.222.0.44 () {62 vars in 1183 bytes} [Fri Feb 19 02:18:32 2021] POST /compute/v2.1/flavors => generated 365 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:18:32.398041 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-b1627adf-e06e-46ec-abf5-ba217fbd46c9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:18:32.433392 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-b1627adf-e06e-46ec-abf5-ba217fbd46c9 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.039925 Feb 19 02:18:32.434025 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 11/23] 10.222.0.44 () {62 vars in 1233 bytes} [Fri Feb 19 02:18:32 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:18:32.445244 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-ede48c1f-ba6e-477f-8618-481ad656d412 admin admin] Calling method '>' {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:18:32.461728 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-ede48c1f-ba6e-477f-8618-481ad656d412 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.020962 Feb 19 02:18:32.462329 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 13/24] 10.222.0.44 () {58 vars in 1180 bytes} [Fri Feb 19 02:18:32 2021] GET /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:18:35.063724 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-78d91d13-f960-4402-b44f-7c2501ec60d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "vcpus": 2, "disk": 40, "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:18:35.087293 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-78d91d13-f960-4402-b44f-7c2501ec60d1 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 366 microversion: 2.1 time: 0.077920 Feb 19 02:18:35.087911 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 12/25] 10.222.0.44 () {62 vars in 1183 bytes} [Fri Feb 19 02:18:35 2021] POST /compute/v2.1/flavors => generated 366 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:18:35.099000 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-3e3a019f-2911-4157-a06b-84680af8cb06 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:18:35.137694 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-3e3a019f-2911-4157-a06b-84680af8cb06 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.042760 Feb 19 02:18:35.138346 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 14/26] 10.222.0.44 () {62 vars in 1233 bytes} [Fri Feb 19 02:18:35 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:18:35.149673 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-e060d242-d626-4200-8e6b-7f274dad8d3b admin admin] Calling method '>' {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:18:35.165907 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-e060d242-d626-4200-8e6b-7f274dad8d3b admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.020937 Feb 19 02:18:35.166546 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 13/27] 10.222.0.44 () {58 vars in 1180 bytes} [Fri Feb 19 02:18:35 2021] GET /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:18:37.782641 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-c3c33a77-a236-4c16-917e-ce7807a2695e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "vcpus": 4, "disk": 80, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:18:37.805681 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-c3c33a77-a236-4c16-917e-ce7807a2695e admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 365 microversion: 2.1 time: 0.077606 Feb 19 02:18:37.806311 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 15/28] 10.222.0.44 () {62 vars in 1183 bytes} [Fri Feb 19 02:18:37 2021] POST /compute/v2.1/flavors => generated 365 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:18:37.817162 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-2a77fa02-3f60-4408-b836-55af6550eb39 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:18:37.853165 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-2a77fa02-3f60-4408-b836-55af6550eb39 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.039735 Feb 19 02:18:37.853730 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 14/29] 10.222.0.44 () {62 vars in 1233 bytes} [Fri Feb 19 02:18:37 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:18:37.864061 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-b9016783-684b-4d83-8573-f009f7a143f3 admin admin] Calling method '>' {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:18:37.880229 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-b9016783-684b-4d83-8573-f009f7a143f3 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.020240 Feb 19 02:18:37.880844 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 16/30] 10.222.0.44 () {58 vars in 1180 bytes} [Fri Feb 19 02:18:37 2021] GET /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:18:40.482155 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-00dbe064-61a1-4292-ba04-5b1c7aabca19 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "vcpus": 8, "disk": 160, "id": "5", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:18:40.504867 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-00dbe064-61a1-4292-ba04-5b1c7aabca19 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 368 microversion: 2.1 time: 0.078721 Feb 19 02:18:40.506137 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 15/31] 10.222.0.44 () {62 vars in 1183 bytes} [Fri Feb 19 02:18:40 2021] POST /compute/v2.1/flavors => generated 368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:18:40.517038 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-49d8629e-49d7-4e19-9b0c-8d6e5842cf0f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:18:40.552673 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-49d8629e-49d7-4e19-9b0c-8d6e5842cf0f admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.039366 Feb 19 02:18:40.553247 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 17/32] 10.222.0.44 () {62 vars in 1233 bytes} [Fri Feb 19 02:18:40 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:18:40.563584 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-54dfdc54-2e9b-42ba-b500-8c568761a813 admin admin] Calling method '>' {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:18:40.580211 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-54dfdc54-2e9b-42ba-b500-8c568761a813 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.1 time: 0.020563 Feb 19 02:18:40.580800 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 16/33] 10.222.0.44 () {58 vars in 1180 bytes} [Fri Feb 19 02:18:40 2021] GET /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:19:52.285869 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-80a30564-82ba-4ce2-af26-20ba219e1ab6 admin admin] Calling method '>' {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:19:52.311690 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-80a30564-82ba-4ce2-af26-20ba219e1ab6 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 3562 microversion: 2.1 time: 0.079116 Feb 19 02:19:52.312281 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 18/34] 10.222.0.44 () {58 vars in 1150 bytes} [Fri Feb 19 02:19:52 2021] GET /compute/v2.1/flavors/detail => generated 3562 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:19:53.961750 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-54dfdc54-2e9b-42ba-b500-8c568761a813 admin admin] Calling method '>' {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:19:53.962897 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-54dfdc54-2e9b-42ba-b500-8c568761a813 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001598 Feb 19 02:19:53.963342 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 17/35] 10.222.0.44 () {56 vars in 1065 bytes} [Fri Feb 19 02:19:53 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:19:54.147535 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-5bf7a007-1f9f-431c-a264-ad68dda02380 admin admin] Calling method '>' {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:19:54.161663 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.wsgi [None req-5bf7a007-1f9f-431c-a264-ad68dda02380 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 19 02:19:54.162293 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-5bf7a007-1f9f-431c-a264-ad68dda02380 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=83322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:19:54.163220 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-5bf7a007-1f9f-431c-a264-ad68dda02380 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.069870 Feb 19 02:19:54.163722 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 19/36] 10.222.0.44 () {60 vars in 1181 bytes} [Fri Feb 19 02:19:54 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 19 02:19:54.173618 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-9d0dafbd-6816-4d96-8d75-f2a96964a825 admin admin] Calling method '>' {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:19:54.195650 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-9d0dafbd-6816-4d96-8d75-f2a96964a825 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.025776 Feb 19 02:19:54.196212 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 18/37] 10.222.0.44 () {60 vars in 1201 bytes} [Fri Feb 19 02:19:54 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:19:54.206466 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-535641be-d590-464d-902a-3d1da59170d5 admin admin] Calling method '>' {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:19:54.228743 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-535641be-d590-464d-902a-3d1da59170d5 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.025943 Feb 19 02:19:54.229313 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 20/38] 10.222.0.44 () {60 vars in 1201 bytes} [Fri Feb 19 02:19:54 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:19:54.239282 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-fa59df42-3fdd-48db-b7ea-883eed1f1f14 admin admin] Calling method '>' {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:19:54.255700 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.wsgi [None req-fa59df42-3fdd-48db-b7ea-883eed1f1f14 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 19 02:19:54.256331 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-fa59df42-3fdd-48db-b7ea-883eed1f1f14 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=83321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:19:54.257176 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-fa59df42-3fdd-48db-b7ea-883eed1f1f14 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.87 time: 0.021755 Feb 19 02:19:54.257722 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 19/39] 10.222.0.44 () {60 vars in 1181 bytes} [Fri Feb 19 02:19:54 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 19 02:19:55.823228 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-535641be-d590-464d-902a-3d1da59170d5 admin admin] Calling method '>' {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:19:55.824340 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-535641be-d590-464d-902a-3d1da59170d5 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001962 Feb 19 02:19:55.824799 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 21/40] 10.222.0.44 () {56 vars in 1065 bytes} [Fri Feb 19 02:19:55 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:19:56.006701 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-f19f6b0b-efdf-4f34-a9a5-b9d7f85d889c admin admin] Calling method '>' {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:19:56.019393 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.wsgi [None req-f19f6b0b-efdf-4f34-a9a5-b9d7f85d889c admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 19 02:19:56.020005 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-f19f6b0b-efdf-4f34-a9a5-b9d7f85d889c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=83321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:19:56.020847 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-f19f6b0b-efdf-4f34-a9a5-b9d7f85d889c admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.067727 Feb 19 02:19:56.021422 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 20/41] 10.222.0.44 () {60 vars in 1181 bytes} [Fri Feb 19 02:19:55 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 19 02:19:56.031636 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-6627b062-c3e7-4717-a67d-6eeef8f289e1 admin admin] Calling method '>' {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:19:56.054169 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-6627b062-c3e7-4717-a67d-6eeef8f289e1 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.026435 Feb 19 02:19:56.054773 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 22/42] 10.222.0.44 () {60 vars in 1201 bytes} [Fri Feb 19 02:19:56 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:19:56.064852 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-b008a65b-f7a8-41e2-9c24-39fa58d17364 admin admin] Calling method '>' {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:19:56.086938 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-b008a65b-f7a8-41e2-9c24-39fa58d17364 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.025800 Feb 19 02:19:56.087501 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 21/43] 10.222.0.44 () {60 vars in 1201 bytes} [Fri Feb 19 02:19:56 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:19:56.097470 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-b0f35d66-0133-4642-a11b-befa9cadf7d0 admin admin] Calling method '>' {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:19:56.110146 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.wsgi [None req-b0f35d66-0133-4642-a11b-befa9cadf7d0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 19 02:19:56.110797 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-b0f35d66-0133-4642-a11b-befa9cadf7d0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=83322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:19:56.111645 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-b0f35d66-0133-4642-a11b-befa9cadf7d0 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.87 time: 0.017917 Feb 19 02:19:56.112184 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 23/44] 10.222.0.44 () {60 vars in 1181 bytes} [Fri Feb 19 02:19:56 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 19 02:19:57.687652 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-b008a65b-f7a8-41e2-9c24-39fa58d17364 admin admin] Calling method '>' {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:19:57.688732 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-b008a65b-f7a8-41e2-9c24-39fa58d17364 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Feb 19 02:19:57.689167 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 22/45] 10.222.0.44 () {56 vars in 1065 bytes} [Fri Feb 19 02:19:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:19:57.874055 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-d2081877-29fc-4a16-a8da-316e305374d2 admin admin] Calling method '>' {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:19:57.887674 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.wsgi [None req-d2081877-29fc-4a16-a8da-316e305374d2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 19 02:19:57.888213 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-d2081877-29fc-4a16-a8da-316e305374d2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=83322) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:19:57.889064 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-d2081877-29fc-4a16-a8da-316e305374d2 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.072854 Feb 19 02:19:57.889621 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 24/46] 10.222.0.44 () {60 vars in 1184 bytes} [Fri Feb 19 02:19:57 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 19 02:19:57.900390 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-737b7793-3070-47c9-81b7-a135ffce6516 admin admin] Calling method '>' {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:19:57.921845 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-737b7793-3070-47c9-81b7-a135ffce6516 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.025314 Feb 19 02:19:57.922451 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 23/47] 10.222.0.44 () {60 vars in 1201 bytes} [Fri Feb 19 02:19:57 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:19:57.932770 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-61d91e8f-d968-4a21-b041-8082646d03bb admin admin] Calling method '>' {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:19:57.958087 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-61d91e8f-d968-4a21-b041-8082646d03bb admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.87 time: 0.028379 Feb 19 02:19:57.958737 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 25/48] 10.222.0.44 () {60 vars in 1201 bytes} [Fri Feb 19 02:19:57 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:19:57.970881 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-06734e16-3fd7-4830-8ed6-a36992d36f4c admin admin] Calling method '>' {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:19:57.984905 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.wsgi [None req-06734e16-3fd7-4830-8ed6-a36992d36f4c admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 19 02:19:57.985523 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-06734e16-3fd7-4830-8ed6-a36992d36f4c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=83321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:19:57.986416 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-06734e16-3fd7-4830-8ed6-a36992d36f4c admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.87 time: 0.019731 Feb 19 02:19:57.987003 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 24/49] 10.222.0.44 () {60 vars in 1184 bytes} [Fri Feb 19 02:19:57 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 19 02:19:59.581717 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-61d91e8f-d968-4a21-b041-8082646d03bb admin admin] Calling method '>' {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:19:59.582853 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-61d91e8f-d968-4a21-b041-8082646d03bb admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Feb 19 02:19:59.583297 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 26/50] 10.222.0.44 () {56 vars in 1065 bytes} [Fri Feb 19 02:19:59 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:19:59.766785 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-3b90219d-909a-443d-ae1d-4f2b2a26f743 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:19:59.791886 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-3b90219d-909a-443d-ae1d-4f2b2a26f743 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.87 time: 0.077497 Feb 19 02:19:59.792445 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 25/51] 10.222.0.44 () {64 vars in 1226 bytes} [Fri Feb 19 02:19:59 2021] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:20:01.339826 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-61d91e8f-d968-4a21-b041-8082646d03bb admin admin] Calling method '>' {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:20:01.340897 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-61d91e8f-d968-4a21-b041-8082646d03bb admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Feb 19 02:20:01.341331 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 27/52] 10.222.0.44 () {56 vars in 1065 bytes} [Fri Feb 19 02:20:01 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:20:01.523250 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-0a8d5fef-dfaf-4d07-bef5-b580fa8b0e0e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:20:01.546686 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-0a8d5fef-dfaf-4d07-bef5-b580fa8b0e0e admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.87 time: 0.076569 Feb 19 02:20:01.547217 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 26/53] 10.222.0.44 () {64 vars in 1226 bytes} [Fri Feb 19 02:20:01 2021] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:20:03.118079 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-61d91e8f-d968-4a21-b041-8082646d03bb admin admin] Calling method '>' {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:20:03.119304 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-61d91e8f-d968-4a21-b041-8082646d03bb admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Feb 19 02:20:03.119738 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 28/54] 10.222.0.44 () {56 vars in 1065 bytes} [Fri Feb 19 02:20:03 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:20:03.309336 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-05359508-3a41-4cdf-988c-bcd8188b6c76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:20:03.332750 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-05359508-3a41-4cdf-988c-bcd8188b6c76 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.87 time: 0.078347 Feb 19 02:20:03.333341 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 27/55] 10.222.0.44 () {64 vars in 1226 bytes} [Fri Feb 19 02:20:03 2021] POST /compute/v2.1/flavors => generated 407 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:20:04.896127 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-61d91e8f-d968-4a21-b041-8082646d03bb admin admin] Calling method '>' {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:20:04.897472 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-61d91e8f-d968-4a21-b041-8082646d03bb admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Feb 19 02:20:04.897830 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 29/56] 10.222.0.44 () {56 vars in 1065 bytes} [Fri Feb 19 02:20:04 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:20:05.087293 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-451b69a4-b1be-47d3-9978-5f3a98044d4f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:20:05.111266 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-451b69a4-b1be-47d3-9978-5f3a98044d4f admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.87 time: 0.079740 Feb 19 02:20:05.111807 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 28/57] 10.222.0.44 () {64 vars in 1226 bytes} [Fri Feb 19 02:20:05 2021] POST /compute/v2.1/flavors => generated 409 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:20:06.687622 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-61d91e8f-d968-4a21-b041-8082646d03bb admin admin] Calling method '>' {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:20:06.688685 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-61d91e8f-d968-4a21-b041-8082646d03bb admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Feb 19 02:20:06.689118 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 30/58] 10.222.0.44 () {56 vars in 1065 bytes} [Fri Feb 19 02:20:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:20:06.874830 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-ada17d8e-bc62-49f8-9155-95ddb4980887 admin admin] Calling method '>' {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:20:06.905978 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-ada17d8e-bc62-49f8-9155-95ddb4980887 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.085960 Feb 19 02:20:06.906606 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 29/59] 10.222.0.44 () {60 vars in 1193 bytes} [Fri Feb 19 02:20:06 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:20:57.857325 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-61d91e8f-d968-4a21-b041-8082646d03bb admin admin] Calling method '>' {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:20:57.858432 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-61d91e8f-d968-4a21-b041-8082646d03bb admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Feb 19 02:20:57.858881 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 31/60] 10.222.0.44 () {56 vars in 1065 bytes} [Fri Feb 19 02:20:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:20:58.048908 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-408a6262-48b2-4b36-8848-7dce65fd0f61 admin admin] Calling method '>' {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:20:58.079335 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-408a6262-48b2-4b36-8848-7dce65fd0f61 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.87 time: 0.088076 Feb 19 02:20:58.080945 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 30/61] 10.222.0.44 () {60 vars in 1193 bytes} [Fri Feb 19 02:20:57 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:22:22.931841 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-f1770791-9161-4e52-9430-072a63ce38cc tempest-verify_tempest_config-1344611381 tempest-verify_tempest_config-1344611381-project] Calling method '>' {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:22:22.933868 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-f1770791-9161-4e52-9430-072a63ce38cc tempest-verify_tempest_config-1344611381 tempest-verify_tempest_config-1344611381-project] 10.222.0.44 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.121749 Feb 19 02:22:22.934459 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 32/62] 10.222.0.44 () {58 vars in 1124 bytes} [Fri Feb 19 02:22:22 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:23:59.447001 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-408a6262-48b2-4b36-8848-7dce65fd0f61 admin admin] Calling method '>' {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:23:59.448084 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-408a6262-48b2-4b36-8848-7dce65fd0f61 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001656 Feb 19 02:23:59.448523 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 31/63] 10.222.0.44 () {56 vars in 1065 bytes} [Fri Feb 19 02:23:59 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:23:59.710083 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-23c75015-c1e6-4194-81a4-bfeeb7cc862a admin admin] Calling method '>' {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:23:59.711359 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:23:59.711359 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: warnings.warn(msg) Feb 19 02:23:59.713172 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG oslo_concurrency.lockutils [None req-23c75015-c1e6-4194-81a4-bfeeb7cc862a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83322) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:23:59.713665 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG oslo_concurrency.lockutils [None req-23c75015-c1e6-4194-81a4-bfeeb7cc862a admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83322) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:23:59.714525 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG oslo_concurrency.lockutils [None req-23c75015-c1e6-4194-81a4-bfeeb7cc862a admin admin] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83322) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:23:59.714993 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG oslo_concurrency.lockutils [None req-23c75015-c1e6-4194-81a4-bfeeb7cc862a admin admin] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=83322) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:23:59.748408 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-23c75015-c1e6-4194-81a4-bfeeb7cc862a admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.87 time: 0.169412 Feb 19 02:23:59.749025 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 33/64] 10.222.0.44 () {60 vars in 1184 bytes} [Fri Feb 19 02:23:59 2021] GET /compute/v2.1/os-services => generated 791 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:24:01.490056 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-408a6262-48b2-4b36-8848-7dce65fd0f61 admin admin] Calling method '>' {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:24:01.491248 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-408a6262-48b2-4b36-8848-7dce65fd0f61 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001597 Feb 19 02:24:01.491705 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 32/65] 10.222.0.44 () {56 vars in 1065 bytes} [Fri Feb 19 02:24:01 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:24:01.695715 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-1a04c3c0-73e5-4b51-9c54-7ef93dfb61ab admin admin] Calling method '>' {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:24:01.696970 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:24:01.696970 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: warnings.warn(msg) Feb 19 02:24:01.698604 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG oslo_concurrency.lockutils [None req-1a04c3c0-73e5-4b51-9c54-7ef93dfb61ab admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83322) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:24:01.699364 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG oslo_concurrency.lockutils [None req-1a04c3c0-73e5-4b51-9c54-7ef93dfb61ab admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83322) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:24:01.700205 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG oslo_concurrency.lockutils [None req-1a04c3c0-73e5-4b51-9c54-7ef93dfb61ab admin admin] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83322) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:24:01.700678 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG oslo_concurrency.lockutils [None req-1a04c3c0-73e5-4b51-9c54-7ef93dfb61ab admin admin] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=83322) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:24:01.732573 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-1a04c3c0-73e5-4b51-9c54-7ef93dfb61ab admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.87 time: 0.093146 Feb 19 02:24:01.733193 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 34/66] 10.222.0.44 () {60 vars in 1184 bytes} [Fri Feb 19 02:24:01 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:24:13.750947 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-408a6262-48b2-4b36-8848-7dce65fd0f61 admin admin] Calling method '>' {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:24:13.752081 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-408a6262-48b2-4b36-8848-7dce65fd0f61 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001593 Feb 19 02:24:13.752514 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 33/67] 10.222.0.44 () {56 vars in 1065 bytes} [Fri Feb 19 02:24:13 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:24:13.935378 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-ee48289a-93ac-4a5f-b308-4c66fbc23f90 admin admin] Calling method '>' {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:24:13.936638 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:24:13.936638 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: warnings.warn(msg) Feb 19 02:24:13.938205 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG oslo_concurrency.lockutils [None req-ee48289a-93ac-4a5f-b308-4c66fbc23f90 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83322) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:24:13.938728 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG oslo_concurrency.lockutils [None req-ee48289a-93ac-4a5f-b308-4c66fbc23f90 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83322) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:24:13.939564 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG oslo_concurrency.lockutils [None req-ee48289a-93ac-4a5f-b308-4c66fbc23f90 admin admin] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83322) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:24:13.940036 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG oslo_concurrency.lockutils [None req-ee48289a-93ac-4a5f-b308-4c66fbc23f90 admin admin] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=83322) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:24:13.968244 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-ee48289a-93ac-4a5f-b308-4c66fbc23f90 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.87 time: 0.087379 Feb 19 02:24:13.968862 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 35/68] 10.222.0.44 () {60 vars in 1184 bytes} [Fri Feb 19 02:24:13 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:24:15.562076 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-408a6262-48b2-4b36-8848-7dce65fd0f61 admin admin] Calling method '>' {{(pid=83321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:24:15.563188 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-408a6262-48b2-4b36-8848-7dce65fd0f61 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001577 Feb 19 02:24:15.563622 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83321|app: 0|req: 34/69] 10.222.0.44 () {56 vars in 1065 bytes} [Fri Feb 19 02:24:15 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:24:15.751062 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG nova.api.openstack.wsgi [None req-84e93901-0745-42d1-981c-fa33193097bf admin admin] Calling method '>' {{(pid=83322) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:24:15.752376 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:24:15.752376 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: warnings.warn(msg) Feb 19 02:24:15.753970 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG oslo_concurrency.lockutils [None req-84e93901-0745-42d1-981c-fa33193097bf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83322) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:24:15.754503 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG oslo_concurrency.lockutils [None req-84e93901-0745-42d1-981c-fa33193097bf admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=83322) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:24:15.755348 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG oslo_concurrency.lockutils [None req-84e93901-0745-42d1-981c-fa33193097bf admin admin] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=83322) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:24:15.755829 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: DEBUG oslo_concurrency.lockutils [None req-84e93901-0745-42d1-981c-fa33193097bf admin admin] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=83322) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:24:15.783508 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: INFO nova.api.openstack.requestlog [None req-84e93901-0745-42d1-981c-fa33193097bf admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.87 time: 0.090636 Feb 19 02:24:15.784028 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: [pid: 83322|app: 0|req: 36/70] 10.222.0.44 () {60 vars in 1184 bytes} [Fri Feb 19 02:24:15 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:25:14.353852 dv-cinder-776422-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Feb 19 02:25:14.354654 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: Fri Feb 19 02:25:14 2021 - graceful shutdown triggered... Feb 19 02:25:14.355114 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: Gracefully killing worker 1 (pid: 83321)... Feb 19 02:25:14.355280 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: Gracefully killing worker 2 (pid: 83322)... Feb 19 02:25:15.355797 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: worker 1 buried after 1 seconds Feb 19 02:25:15.355797 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: worker 2 buried after 1 seconds Feb 19 02:25:15.355797 dv-cinder-776422-2-iscsi devstack@n-api.service[83320]: goodbye to uWSGI. Feb 19 02:25:15.357522 dv-cinder-776422-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Feb 19 02:25:15.359237 dv-cinder-776422-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 19 02:25:15.367274 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 19 02:25:15.369232 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: *** Starting uWSGI 2.0.15-debian (64bit) on [Fri Feb 19 02:25:15 2021] *** Feb 19 02:25:15.369232 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: compiled with version: 7.3.0 on 28 September 2018 15:41:15 Feb 19 02:25:15.369232 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: os: Linux-4.15.0-55-generic #60-Ubuntu SMP Tue Jul 2 18:22:20 UTC 2019 Feb 19 02:25:15.369232 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: nodename: dv-cinder-776422-2-iscsi Feb 19 02:25:15.369232 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: machine: x86_64 Feb 19 02:25:15.369232 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: clock source: unix Feb 19 02:25:15.369232 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: pcre jit disabled Feb 19 02:25:15.369232 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: detected number of CPU cores: 4 Feb 19 02:25:15.369232 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: current working directory: / Feb 19 02:25:15.369232 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: detected binary path: /usr/bin/uwsgi-core Feb 19 02:25:15.369232 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: dropping root privileges as early as possible Feb 19 02:25:15.369232 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: your processes number limit is 47843 Feb 19 02:25:15.370327 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: your memory page size is 4096 bytes Feb 19 02:25:15.370327 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: detected max file descriptor number: 2048 Feb 19 02:25:15.370327 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: lock engine: pthread robust mutexes Feb 19 02:25:15.370327 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: thunder lock: enabled Feb 19 02:25:15.370327 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 19 02:25:15.370327 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: dropping root privileges after socket binding Feb 19 02:25:15.370327 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: Python version: 3.6.9 (default, Oct 8 2020, 12:12:24) [GCC 8.4.0] Feb 19 02:25:15.416212 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: Python main interpreter initialized at 0x56543a8279c0 Feb 19 02:25:15.416212 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: dropping root privileges after plugin initialization Feb 19 02:25:15.416212 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: python threads support enabled Feb 19 02:25:15.416212 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: your server socket listen backlog is limited to 100 connections Feb 19 02:25:15.416212 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: your mercy for graceful operations on workers is 90 seconds Feb 19 02:25:15.416809 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: mapped 402621 bytes (393 KB) for 2 cores Feb 19 02:25:15.416809 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: *** Operational MODE: preforking *** Feb 19 02:25:15.416993 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: dropping root privileges after application loading Feb 19 02:25:15.416993 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: *** uWSGI is running in multiple interpreter mode *** Feb 19 02:25:15.416993 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: spawned uWSGI master process (pid: 98192) Feb 19 02:25:15.417125 dv-cinder-776422-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 19 02:25:15.417421 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: spawned uWSGI worker 1 (pid: 98193, cores: 1) Feb 19 02:25:15.417783 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: spawned uWSGI worker 2 (pid: 98194, cores: 1) Feb 19 02:25:15.417880 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 19 02:25:20.079597 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Feb 19 02:25:20.080220 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Feb 19 02:25:20.081482 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Feb 19 02:25:20.081633 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2567}} Feb 19 02:25:20.081823 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2568}} Feb 19 02:25:20.081932 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Feb 19 02:25:20.082190 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Feb 19 02:25:20.082693 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.083269 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.083414 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.083598 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2569}} Feb 19 02:25:20.083712 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.084045 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2571}} Feb 19 02:25:20.084158 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.084403 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2572}} Feb 19 02:25:20.084526 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.084758 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.084880 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.085182 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.085304 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.085561 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.085682 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.085858 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.085979 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.086216 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.086334 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.086617 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-776422-2-iscsi {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.086742 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.086987 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.087104 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.087337 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.087455 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.087689 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.087798 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.088029 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.088148 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.088375 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.088483 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.088741 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.088907 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-776422-2-iscsi {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.089087 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.089200 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.089432 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.089700 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.089870 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.090048 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.090160 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.090422 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.090540 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.090771 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.090884 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.091160 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.091271 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.091510 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.091803 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.091935 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.092166 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.092277 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.092518 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.092625 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.092877 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.092992 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.093225 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.093378 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.093592 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-776422-2-iscsi {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.093701 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.093940 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.094059 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.094285 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.094412 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.094667 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.094775 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.095076 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.095190 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.095433 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.095541 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.095807 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-776422-2-iscsi {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.095917 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.096163 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.096272 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.096513 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.096621 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.096854 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.096955 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.097234 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.097351 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.097601 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.097718 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.097967 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.098075 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.098332 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.098553 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.098716 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.098831 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.099065 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.099169 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.099408 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.099521 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.099770 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.099888 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.100116 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.100230 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.100461 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.100571 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.100749 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.100964 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.101067 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.101171 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.101436 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.101546 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.101795 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.101898 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.102150 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.102261 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.102457 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.102562 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.102748 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.102857 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.103115 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.103229 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.103480 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.103625 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.103829 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.103938 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.104177 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.104432 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.104534 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.104803 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.104936 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.105097 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.105209 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.105456 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.105567 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.105807 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.105916 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.106158 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.106260 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.106545 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.106669 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.106901 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.107003 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.107253 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.107360 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.107625 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.107734 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.107973 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.108083 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.108340 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.108447 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.108684 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.108804 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.109057 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.109180 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.109425 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.109527 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.109799 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.109896 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.110132 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.110263 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.110568 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.110835 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.111011 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.111257 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.111362 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.111575 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.111678 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.111930 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.112050 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.112298 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.112408 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.112670 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.112772 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.113015 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.113175 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.113323 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.113435 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.113616 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.113767 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.113962 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.114120 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.114324 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.114486 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.114747 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.114904 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.115121 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.115280 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.115463 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.115619 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.115929 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.116089 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.116089 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.116334 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.116484 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.116586 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.116794 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.116905 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.117148 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.117271 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.117488 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.117600 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.117831 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.117942 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.118180 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.118299 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.118549 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.118678 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.118895 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.119005 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.119239 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.119352 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.119595 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.119698 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.119932 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.120035 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.120274 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.120385 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.120613 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.120769 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.120957 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.121076 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.121393 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.121501 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.121599 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.121704 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.121955 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.122072 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.122325 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.122464 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.122690 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.122793 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.123647 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.123817 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.124019 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.124163 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.124367 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.124519 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.124715 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.124879 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.125079 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.125257 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.125418 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.125631 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.125746 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.126022 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.126132 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.126459 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.126581 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.126764 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.126876 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.127108 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.127220 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.127451 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.127559 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.127795 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.127905 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.128138 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.128247 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.128481 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.128590 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.128822 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.128940 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.129160 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.129269 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.129520 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.129629 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.129875 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.129985 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.130217 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.130319 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.130590 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.130734 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.130934 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.131041 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.131286 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.131389 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.131637 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.131749 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.131987 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.132095 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.132334 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.132442 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.132698 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.132809 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.133065 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.133175 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.133418 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.133527 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.133768 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.133919 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.134107 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.134223 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.134473 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.134612 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2581}} Feb 19 02:25:20.134847 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.134962 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.135198 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.135307 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.135550 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.135652 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.135898 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.136008 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.136266 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.136368 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.136625 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.136728 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.136981 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.137133 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.137331 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.137439 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.137678 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.137788 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.138028 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.138130 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.138470 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.138591 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.138809 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.139418 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.139672 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.139781 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.140047 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.140161 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.140410 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.140521 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.140789 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.140927 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.141149 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.141257 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.141512 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.141681 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.141858 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.141974 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.142207 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.142371 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.142604 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.142723 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.142965 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.143075 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.143320 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.143423 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.143671 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.143765 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.144020 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.144111 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.144370 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.144459 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.144722 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.144812 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.145104 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.145195 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.145453 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.145536 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.145808 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.145897 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.146154 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.146243 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.146524 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.146625 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.146871 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.146962 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.147221 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.147311 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.147557 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.147649 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.147905 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.147988 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.148271 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.148361 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.148617 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.148709 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.148965 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.149056 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.149314 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.149397 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.149656 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.149755 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.149995 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.150123 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.150334 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.150491 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.150713 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.150845 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.151064 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.151190 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.151410 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.151515 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.151749 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.151861 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.152109 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.152218 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.152455 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.152563 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.152808 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.152922 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.153148 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.153252 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.153493 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.153596 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.153839 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.153943 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.154183 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.154287 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.154582 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.154670 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.154932 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.155016 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.155282 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.155365 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.155630 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.155721 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.155986 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.156075 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.156326 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.156415 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.156675 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.156758 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.157033 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.157124 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.157386 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.157469 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.157741 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.157836 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.158093 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.158188 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.158515 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.158624 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.158813 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.158909 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.159193 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.159276 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.159543 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.159637 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.159889 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.159980 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.160237 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.160321 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.160582 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.160682 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.160925 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.161099 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.161256 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.161382 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.161606 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.161764 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.161985 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.162169 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.162337 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.162543 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.162708 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.162863 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.163163 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.163320 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.163473 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.163630 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.163787 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.163945 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.164120 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.164266 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.164427 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.164578 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.164730 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.164883 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.165058 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.165213 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.165371 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.165520 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.165658 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.165801 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.165949 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.166101 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.166258 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.166465 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.166625 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.166773 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.166945 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.167093 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.167259 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.167409 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.167559 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.167717 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.167873 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.168023 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.168180 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.168330 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.168552 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.168714 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.168869 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.169019 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.169162 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.169314 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.169462 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.169612 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.169751 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.169889 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.170128 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.170292 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.170639 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.170817 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.171017 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.171218 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.171408 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.171595 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.171782 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.171960 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.171960 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.172273 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.172441 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.172607 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.172786 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.172946 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.173099 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.173264 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.173427 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.173599 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.173784 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.173967 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.174499 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.174665 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.174821 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.174986 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.175151 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.175315 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.175569 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.175749 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.175916 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.176085 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.176263 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.176438 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.176611 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.176778 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.176945 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.177121 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.177121 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.177431 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.177431 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.177752 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.177916 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.178102 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.178102 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.178452 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.178630 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.178788 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.178940 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.179104 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.179104 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.179380 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.179537 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.179667 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.179743 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.179831 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.179905 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.179975 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.180045 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.180114 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.180191 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.180271 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.180344 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.180414 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.180608 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.180699 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.180950 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.181041 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.181293 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.181383 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.181628 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.181718 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.181983 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.182067 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.182338 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.182492 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.182704 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.182794 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.183046 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.183136 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.183395 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.183485 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.183738 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.183828 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.184081 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.184180 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.184422 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.184505 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.184769 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.184864 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.185118 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.185208 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.185463 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.186071 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.186334 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.186457 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.186712 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.186813 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.187069 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.187159 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.187456 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.187786 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.187873 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.188152 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.188243 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.188504 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.188644 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.188858 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.189008 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.189214 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.189386 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.189553 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.189730 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.189893 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.190046 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.190190 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.190342 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.190620 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.190901 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.191067 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.191275 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.191431 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.191576 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.191729 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.191898 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.192056 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.192218 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.192367 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.192528 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.192695 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.192859 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.193019 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.193166 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.193312 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.193517 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.193691 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.193844 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.194002 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.194152 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.194312 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.194573 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.194826 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.194990 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.195142 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.195301 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.195445 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.195596 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.195760 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.195901 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.196047 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.196192 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.196343 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.196453 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.196575 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.196817 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.196941 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.197160 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.197279 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.197496 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.197653 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.197796 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.197951 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.198171 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.198381 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.198574 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.198745 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.198915 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.199080 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.199245 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.199413 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.199828 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.199987 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.200166 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.200348 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.200525 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.200687 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.200867 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.201028 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.201254 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.201912 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.202071 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.202235 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.202423 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.202579 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.202743 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.202909 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.203092 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.203256 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.203426 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.203593 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.203751 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.203906 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.204054 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.204223 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.204384 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.204557 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.204721 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.204896 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.205062 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.205243 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.205551 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.205730 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.205951 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.206153 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.206434 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.206651 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.206851 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.207042 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.207228 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.207418 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.207614 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.207797 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.207969 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.208564 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.208707 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.208823 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.208912 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.208986 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.209063 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.209164 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.209260 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.209364 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.209470 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.209612 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.209745 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.209915 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.210050 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.210188 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.210298 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.210428 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.210632 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.210742 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.210976 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.211077 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.211329 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.211432 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.211673 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.211776 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.212019 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.212121 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.212357 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.212459 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.212698 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.212800 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.213040 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.213154 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.213375 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.213483 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.213720 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.213822 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.214062 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.214174 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.214414 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.214519 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.214760 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.214873 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.215107 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.215222 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.215444 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.215547 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.215787 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.215896 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.216121 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.216235 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.216458 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.216567 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.216825 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.216978 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.217174 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.217267 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.217520 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.217602 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.217891 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.217973 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.218242 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.218325 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.218616 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.218700 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.218961 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.219070 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.219296 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.219400 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.219652 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.219754 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.220005 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.220108 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.220352 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.220454 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.220784 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.220899 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.221095 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.221207 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.221386 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.221559 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.221738 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.221922 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.222109 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.222236 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.222486 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.222634 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.222891 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.223012 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.223132 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.223319 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.223481 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.223672 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.223834 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.224016 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.224183 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.224385 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.224533 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.224741 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.224883 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.225093 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.225238 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.225460 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.225564 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.225830 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.225933 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.226202 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.226312 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.226581 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.226686 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.226923 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.227034 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.227268 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.227495 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.227640 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.227754 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.227926 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.228052 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.228268 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.228406 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.228618 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.228722 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.228961 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.229064 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.229305 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.229420 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.229641 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.229750 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.229986 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.230162 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.230322 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.230522 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.230698 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.230854 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.231050 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.231208 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.231396 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.231560 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.231764 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.231905 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.232114 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.232260 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.232486 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.232639 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.232840 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.232998 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.233187 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.233355 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.233541 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.233701 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.233892 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.234184 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.234422 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.234583 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.234782 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.234935 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.235137 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.235286 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.235484 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.235632 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.235837 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.235975 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.236190 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.236329 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.236696 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.236877 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.237047 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.237233 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.237369 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.237513 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.237661 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.237810 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.238005 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.238165 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.238342 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.238550 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.238728 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.238913 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.239222 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.239353 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.239571 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.239730 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.239882 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.240035 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.240257 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.240406 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.240603 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.240757 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.240915 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.241055 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.241266 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.241420 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.241638 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.241783 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.241985 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.242222 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.242496 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.242641 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.242795 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.242936 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.243095 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.243237 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.243376 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.243523 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.243747 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.243935 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.244096 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.244292 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.244438 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.244646 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.244801 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.245016 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.245173 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.245386 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.245532 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.245750 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.245905 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.246058 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.246204 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.246439 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.246593 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.246796 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.246941 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.247168 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.247318 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.247538 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.247731 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.247877 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.248589 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.248723 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.248917 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.249037 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.249148 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.249418 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.249574 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.249730 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.249872 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.250069 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.250215 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.250480 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.250642 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.250826 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.250970 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.251178 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.251324 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.251529 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.251692 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.251882 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.252025 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.252225 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.252389 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.252544 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.252708 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.252915 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.253090 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.253257 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.253423 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.253592 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.253769 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.253931 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.254097 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.254448 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.254616 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.254789 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.254958 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.255113 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.255270 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.255426 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.255589 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.255757 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.255911 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.256057 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.256216 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.256378 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.256543 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.256714 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.256879 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.257039 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.257185 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.257325 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.257473 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.257626 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.257833 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.257985 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.258158 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.258313 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.258557 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.258720 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.258907 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.259036 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.259277 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.259404 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.259628 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.259793 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.260029 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.260181 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.260331 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.260489 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.260730 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.260882 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.261031 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.261196 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.261354 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.261502 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.261657 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.261815 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.261967 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.262120 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.262284 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.262485 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.262655 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.262804 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.262957 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.263123 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.263277 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.263455 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.263622 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.263835 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.264502 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.264680 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.264854 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.265017 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.265174 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.265327 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.265482 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.265651 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.265818 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.265980 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.266141 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.266308 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.266566 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.266734 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.266892 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.267049 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.267214 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.267368 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.267532 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.267819 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.268018 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.268230 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.268391 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.268551 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.268752 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.268943 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.268943 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.269305 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.269488 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.269662 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.269837 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.270000 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.270156 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.270311 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.270516 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.270691 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.270872 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.271035 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.271211 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.271389 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.271556 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.271740 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.271928 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.272108 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.272108 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.272436 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.272603 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.272779 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.272952 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.273137 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.273308 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.273484 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.273484 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.273807 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.273978 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.274157 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.274273 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.274392 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.274507 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.274622 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.274722 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.274819 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.274925 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.275030 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.275135 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.275358 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.275470 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.275710 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.275813 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.276059 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.276169 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.276399 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.276503 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.276749 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.276860 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.277099 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.277385 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.277495 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.277762 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.277878 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.278145 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.driver = filter_scheduler {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.278293 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.278528 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.278635 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.278877 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.279015 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.279225 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.279388 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.279602 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.279710 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.279948 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.280052 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.280329 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.periodic_task_interval = 60 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.280506 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.280684 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.280794 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.281021 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.281132 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.281364 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.281484 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.281719 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.281830 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.282079 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.282182 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.282473 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.282581 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.282829 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.282942 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.283183 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.283286 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.283541 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.283692 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.285421 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.285550 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.285885 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.285995 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.286123 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.286240 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.286347 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.286491 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.286596 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.286711 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.286812 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.286911 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.287011 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.287109 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.287216 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.287325 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.287433 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.287533 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.287639 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.287738 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.287738 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.287958 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.288043 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.288116 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.288194 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.288273 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.288462 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.288575 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.288815 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.288927 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.289172 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.289259 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.289526 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.289670 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.289878 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.289999 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.290222 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.290335 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.290592 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.290704 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.290941 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.291046 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.291282 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.291387 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.291632 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.291858 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.291988 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.292217 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.292342 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.292596 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.292748 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.292952 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.293064 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.293299 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.293403 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.293649 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.293919 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.294024 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.294326 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.294467 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.294691 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.294805 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.295064 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.295176 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.295416 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.295521 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.295766 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.295883 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.296102 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.296213 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.296454 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.296565 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.296794 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.296910 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.297129 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.297239 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.297478 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.297590 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.297820 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.297925 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.298156 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.298468 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.298588 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.298847 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.298969 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.299223 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.299453 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.299643 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.299856 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.300070 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.300252 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.300366 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.300512 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.300624 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.300847 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.300965 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.301191 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.301295 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.301535 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.301640 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.301880 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.301995 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.302225 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.302336 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.302600 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.302706 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.302937 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.303058 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.303274 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.303384 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.303615 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.303719 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.303957 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.304069 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.304292 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.304404 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.304634 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.304745 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.304970 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.305086 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.305306 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.305417 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.305653 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.305757 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.305993 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.306098 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.306339 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.306489 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.306702 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.306805 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.307043 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.307148 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.307389 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.307517 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.307737 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.307843 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.308074 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.308188 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.308418 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.308550 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.308763 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.308880 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.309099 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.309435 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.309521 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.309779 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.309870 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.310123 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.310423 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.310514 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.311341 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.311438 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.311705 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.311799 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.312045 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.312157 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.312387 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.312491 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.312743 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.312868 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.313097 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.313210 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.313434 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.313547 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.313788 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.313903 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.314131 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.314242 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.314507 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.314835 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.314954 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.315183 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.315294 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.315532 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.315804 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.315907 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.316189 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.316300 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.316530 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.316642 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.316881 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.316985 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.317229 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.317347 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.317603 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.317706 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.317949 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.318054 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.318298 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.318438 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.318676 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.318780 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.319022 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.319133 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.319365 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.319469 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.319711 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.319814 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.320053 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.320199 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.320395 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.320519 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.320746 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.320860 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.321086 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.321198 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.321437 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.321551 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.321775 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.321887 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.322116 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.322269 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.322532 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.322644 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.322896 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.323001 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.323256 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.323366 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.323614 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.323718 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.323974 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.324123 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.324326 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.324430 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.324949 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.325055 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.325301 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.325413 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.325645 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.325749 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.325990 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.326094 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.326937 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.327066 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.327297 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.327389 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.327644 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.327756 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.328062 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.328167 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.328426 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.328531 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.328836 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.328969 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.329174 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.329287 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.329532 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.329636 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.329885 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.329997 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.330240 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.330435 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.330617 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.330746 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.330970 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.331083 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.331334 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.331465 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.331695 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.331800 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.332035 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.332146 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.332383 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.332487 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.332750 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.332859 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.333109 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.333237 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.333467 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.333824 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.333824 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.336983 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.337125 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.337235 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.337345 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.337447 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.337554 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.337664 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.337777 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.337878 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.337985 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.338085 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.338085 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.338279 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.338408 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.338511 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.338618 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.338719 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.338818 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.338936 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.339044 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.339145 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.339244 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.339348 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.339454 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.339561 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.339674 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.339777 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.339879 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.339978 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.340077 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.340161 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.340236 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.340309 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.340380 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.340452 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.340530 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.340610 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.340691 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.340764 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.340764 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.340906 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.340906 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.341055 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.341170 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.341254 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.341505 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.341597 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.341893 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.342011 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.342247 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.342423 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.342627 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.342735 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.342978 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.343083 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.343328 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.343434 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.343682 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.343796 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.344030 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.344141 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.344377 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.344495 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.344721 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.344839 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.345070 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.345176 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.345422 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.345527 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.345779 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.345932 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.346147 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.346532 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.346653 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.346907 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.347088 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.347279 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.347469 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.347671 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.347838 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.348028 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.348204 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.348420 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.348567 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.348796 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.348907 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.349078 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98194) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Feb 19 02:25:20.349275 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.349631 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.349991 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.350348 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.350730 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.351091 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.351450 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.351823 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.352193 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.352563 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.352936 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.353335 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.353691 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.354087 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.354511 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2589}} Feb 19 02:25:20.354795 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=98193) log_opt_values /usr/local/lib/python3.6/dist-packages/oslo_config/cfg.py:2591}} Feb 19 02:25:20.386760 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_db.sqlalchemy.engines [None req-f0e4b3f8-45f2-4c73-a7cd-332de29daa32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98194) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 19 02:25:20.391892 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_db.sqlalchemy.engines [None req-c7096b01-7d85-4149-b2cf-7cad37df1517 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98193) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 19 02:25:20.651343 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.context [None req-f0e4b3f8-45f2-4c73-a7cd-332de29daa32 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8(cell1) {{(pid=98194) load_cells /opt/stack/nova/nova/context.py:466}} Feb 19 02:25:20.656921 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f0e4b3f8-45f2-4c73-a7cd-332de29daa32 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:25:20.660006 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f0e4b3f8-45f2-4c73-a7cd-332de29daa32 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:25:20.660006 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f0e4b3f8-45f2-4c73-a7cd-332de29daa32 None None] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:25:20.661837 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f0e4b3f8-45f2-4c73-a7cd-332de29daa32 None None] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:25:20.664031 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.context [None req-c7096b01-7d85-4149-b2cf-7cad37df1517 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8(cell1) {{(pid=98193) load_cells /opt/stack/nova/nova/context.py:466}} Feb 19 02:25:20.672233 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c7096b01-7d85-4149-b2cf-7cad37df1517 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:25:20.672683 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c7096b01-7d85-4149-b2cf-7cad37df1517 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:25:20.673784 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c7096b01-7d85-4149-b2cf-7cad37df1517 None None] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:25:20.677204 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c7096b01-7d85-4149-b2cf-7cad37df1517 None None] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:25:20.683930 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_db.sqlalchemy.engines [None req-f0e4b3f8-45f2-4c73-a7cd-332de29daa32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98194) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 19 02:25:20.701756 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_db.sqlalchemy.engines [None req-f0e4b3f8-45f2-4c73-a7cd-332de29daa32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98194) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 19 02:25:20.714572 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_db.sqlalchemy.engines [None req-c7096b01-7d85-4149-b2cf-7cad37df1517 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98193) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 19 02:25:20.715474 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_db.sqlalchemy.engines [None req-c7096b01-7d85-4149-b2cf-7cad37df1517 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98193) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 19 02:25:20.730912 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_db.sqlalchemy.engines [None req-f0e4b3f8-45f2-4c73-a7cd-332de29daa32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98194) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 19 02:25:20.752558 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_db.sqlalchemy.engines [None req-c7096b01-7d85-4149-b2cf-7cad37df1517 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=98193) _check_effective_sql_mode /usr/local/lib/python3.6/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Feb 19 02:25:20.827115 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 19 02:25:20.827115 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: from cryptography.utils import int_from_bytes Feb 19 02:25:20.827574 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 19 02:25:20.827574 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: from cryptography.utils import int_from_bytes Feb 19 02:25:20.838699 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 19 02:25:20.838699 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: from cryptography.utils import int_from_bytes Feb 19 02:25:20.839183 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 19 02:25:20.839183 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: from cryptography.utils import int_from_bytes Feb 19 02:25:20.905876 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO keyring.backend [None req-f0e4b3f8-45f2-4c73-a7cd-332de29daa32 None None] Loading Gnome Feb 19 02:25:20.920037 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO keyring.backend [None req-c7096b01-7d85-4149-b2cf-7cad37df1517 None None] Loading Gnome Feb 19 02:25:20.936707 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO keyring.backend [None req-f0e4b3f8-45f2-4c73-a7cd-332de29daa32 None None] Loading Google Feb 19 02:25:20.940266 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO keyring.backend [None req-f0e4b3f8-45f2-4c73-a7cd-332de29daa32 None None] Loading Windows (alt) Feb 19 02:25:20.941802 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO keyring.backend [None req-c7096b01-7d85-4149-b2cf-7cad37df1517 None None] Loading Google Feb 19 02:25:20.944975 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO keyring.backend [None req-f0e4b3f8-45f2-4c73-a7cd-332de29daa32 None None] Loading file Feb 19 02:25:20.945411 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO keyring.backend [None req-c7096b01-7d85-4149-b2cf-7cad37df1517 None None] Loading Windows (alt) Feb 19 02:25:20.946246 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO keyring.backend [None req-f0e4b3f8-45f2-4c73-a7cd-332de29daa32 None None] Loading keyczar Feb 19 02:25:20.946898 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO keyring.backend [None req-f0e4b3f8-45f2-4c73-a7cd-332de29daa32 None None] Loading multi Feb 19 02:25:20.947774 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO keyring.backend [None req-f0e4b3f8-45f2-4c73-a7cd-332de29daa32 None None] Loading pyfs Feb 19 02:25:20.951276 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO keyring.backend [None req-c7096b01-7d85-4149-b2cf-7cad37df1517 None None] Loading file Feb 19 02:25:20.952409 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO keyring.backend [None req-c7096b01-7d85-4149-b2cf-7cad37df1517 None None] Loading keyczar Feb 19 02:25:20.952871 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO keyring.backend [None req-c7096b01-7d85-4149-b2cf-7cad37df1517 None None] Loading multi Feb 19 02:25:20.953891 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO keyring.backend [None req-c7096b01-7d85-4149-b2cf-7cad37df1517 None None] Loading pyfs Feb 19 02:25:21.344195 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: WARNING keystonemiddleware.auth_token [None req-c7096b01-7d85-4149-b2cf-7cad37df1517 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 19 02:25:21.358485 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: WARNING keystonemiddleware.auth_token [None req-c7096b01-7d85-4149-b2cf-7cad37df1517 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 19 02:25:21.358737 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: WARNING keystonemiddleware.auth_token [None req-f0e4b3f8-45f2-4c73-a7cd-332de29daa32 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 19 02:25:21.360464 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: WARNING keystonemiddleware.auth_token [None req-f0e4b3f8-45f2-4c73-a7cd-332de29daa32 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 19 02:25:21.592476 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: WARNING keystonemiddleware.auth_token [None req-c7096b01-7d85-4149-b2cf-7cad37df1517 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 19 02:25:21.598323 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: WARNING keystonemiddleware.auth_token [None req-c7096b01-7d85-4149-b2cf-7cad37df1517 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 19 02:25:21.598976 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: WARNING keystonemiddleware.auth_token [None req-f0e4b3f8-45f2-4c73-a7cd-332de29daa32 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 19 02:25:21.603916 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56543a8279c0 pid: 98193 (default app) Feb 19 02:25:21.604722 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: WARNING keystonemiddleware.auth_token [None req-f0e4b3f8-45f2-4c73-a7cd-332de29daa32 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 19 02:25:21.610292 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56543a8279c0 pid: 98194 (default app) Feb 19 02:26:00.605737 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d9a00339-6609-417d-88a7-59bf93dddb9d tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] Action: 'create', calling method: .version_select at 0x7f217e188730>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1622798524"}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:26:02.472692 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d9a00339-6609-417d-88a7-59bf93dddb9d tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.170923 Feb 19 02:26:02.475208 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 1/1] 10.222.0.44 () {60 vars in 1145 bytes} [Fri Feb 19 02:25:59 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 3175 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 19 02:26:03.088591 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-db1442e9-d17f-458d-9294-097d6f39ca82 tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] Calling method '.version_select at 0x7f217e1df2f0>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:03.859994 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-db1442e9-d17f-458d-9294-097d6f39ca82 tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/b7c353f4-a051-4b9d-936f-62fc4ce287b0" status: 200 len: 346 microversion: 2.1 time: 1.370252 Feb 19 02:26:03.860569 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 1/2] 10.222.0.44 () {58 vars in 1235 bytes} [Fri Feb 19 02:26:02 2021] GET /compute/v2.1/os-volumes/b7c353f4-a051-4b9d-936f-62fc4ce287b0 => generated 346 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:26:03.874394 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f3e82cf2-3ed2-441d-880d-378b9f28f0d9 tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] Action: 'create', calling method: .version_select at 0x7f217e049048>, body: {"snapshot": {"volume_id": "b7c353f4-a051-4b9d-936f-62fc4ce287b0", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-239464218"}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:26:04.367667 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f3e82cf2-3ed2-441d-880d-378b9f28f0d9 tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] 10.222.0.44 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.498417 Feb 19 02:26:04.368280 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 2/3] 10.222.0.44 () {60 vars in 1152 bytes} [Fri Feb 19 02:26:03 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:26:04.382148 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b8a0368a-b34f-487a-bdc0-695cf948d362 tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] Calling method '.version_select at 0x7f217e1df7b8>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:04.472689 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b8a0368a-b34f-487a-bdc0-695cf948d362 tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/b271d4ed-3743-4f0e-931a-b57da1dcbff3" status: 200 len: 286 microversion: 2.1 time: 0.097036 Feb 19 02:26:04.473320 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 2/4] 10.222.0.44 () {58 vars in 1241 bytes} [Fri Feb 19 02:26:04 2021] GET /compute/v2.1/os-snapshots/b271d4ed-3743-4f0e-931a-b57da1dcbff3 => generated 286 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:26:04.484215 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-9c095ed2-ceac-461e-b182-a91d7e5ccf95 tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] Calling method '.version_select at 0x7f217e120488>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:04.565167 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-9c095ed2-ceac-461e-b182-a91d7e5ccf95 tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.085074 Feb 19 02:26:04.565801 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 3/5] 10.222.0.44 () {58 vars in 1130 bytes} [Fri Feb 19 02:26:04 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:26:04.577529 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1a35c921-73dd-4574-bdcf-61f66fea673c tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] Calling method '.version_select at 0x7f217e1df840>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:04.640178 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1a35c921-73dd-4574-bdcf-61f66fea673c tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/b271d4ed-3743-4f0e-931a-b57da1dcbff3" status: 200 len: 286 microversion: 2.1 time: 0.067307 Feb 19 02:26:04.641119 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 3/6] 10.222.0.44 () {58 vars in 1241 bytes} [Fri Feb 19 02:26:04 2021] GET /compute/v2.1/os-snapshots/b271d4ed-3743-4f0e-931a-b57da1dcbff3 => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:26:05.653230 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-80bd5558-3804-46c6-b60a-229561ca60d9 tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] Calling method '.version_select at 0x7f217e120bf8>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:05.705020 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-80bd5558-3804-46c6-b60a-229561ca60d9 tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/b271d4ed-3743-4f0e-931a-b57da1dcbff3" status: 200 len: 286 microversion: 2.1 time: 0.055675 Feb 19 02:26:05.705790 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 4/7] 10.222.0.44 () {58 vars in 1241 bytes} [Fri Feb 19 02:26:05 2021] GET /compute/v2.1/os-snapshots/b271d4ed-3743-4f0e-931a-b57da1dcbff3 => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:26:06.717681 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-385edd02-ffa3-4455-aece-bad88c43ec2b tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] Calling method '.version_select at 0x7f217e1650d0>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:06.803952 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-385edd02-ffa3-4455-aece-bad88c43ec2b tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/b271d4ed-3743-4f0e-931a-b57da1dcbff3" status: 200 len: 286 microversion: 2.1 time: 0.090154 Feb 19 02:26:06.808847 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 4/8] 10.222.0.44 () {58 vars in 1241 bytes} [Fri Feb 19 02:26:06 2021] GET /compute/v2.1/os-snapshots/b271d4ed-3743-4f0e-931a-b57da1dcbff3 => generated 286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:26:07.196777 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a40dc0fe-89b1-4170-b0b4-f5b847871e93 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1044362640", "imageRef": "37a0f9d8-d3f7-417e-bce6-371e41a47c88", "flavorRef": "452", "networks": [{"uuid": "3908b16a-e19b-41bd-97dc-6a73ee1a771a"}]}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:26:07.400165 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-a40dc0fe-89b1-4170-b0b4-f5b847871e93 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] validate_networks() for [('3908b16a-e19b-41bd-97dc-6a73ee1a771a', None, None, None)] {{(pid=98193) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 02:26:07.822871 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-3b91089f-21f4-4668-ba85-550a857c619b tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] Calling method '.version_select at 0x7f217e165598>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:07.885391 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-3b91089f-21f4-4668-ba85-550a857c619b tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/b271d4ed-3743-4f0e-931a-b57da1dcbff3" status: 200 len: 287 microversion: 2.1 time: 0.071875 Feb 19 02:26:07.895489 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 5/9] 10.222.0.44 () {58 vars in 1241 bytes} [Fri Feb 19 02:26:07 2021] GET /compute/v2.1/os-snapshots/b271d4ed-3743-4f0e-931a-b57da1dcbff3 => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:26:07.902008 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b859d49d-f79b-4261-b35a-13b8e28bb4e7 tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] Calling method '.version_select at 0x7f217e1658c8>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:08.108239 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b859d49d-f79b-4261-b35a-13b8e28bb4e7 tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] 10.222.0.44 "DELETE /compute/v2.1/os-snapshots/b271d4ed-3743-4f0e-931a-b57da1dcbff3" status: 202 len: 0 microversion: 2.1 time: 0.210424 Feb 19 02:26:08.108864 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 6/10] 10.222.0.44 () {58 vars in 1244 bytes} [Fri Feb 19 02:26:07 2021] DELETE /compute/v2.1/os-snapshots/b271d4ed-3743-4f0e-931a-b57da1dcbff3 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:26:08.117307 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c8b12ec6-0ab8-40d8-8fc8-593ec1aec1a6 tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] Calling method '.version_select at 0x7f217e19fea0>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:08.210326 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c8b12ec6-0ab8-40d8-8fc8-593ec1aec1a6 tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/b271d4ed-3743-4f0e-931a-b57da1dcbff3" status: 200 len: 286 microversion: 2.1 time: 0.096855 Feb 19 02:26:08.211375 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 7/11] 10.222.0.44 () {58 vars in 1241 bytes} [Fri Feb 19 02:26:08 2021] GET /compute/v2.1/os-snapshots/b271d4ed-3743-4f0e-931a-b57da1dcbff3 => generated 286 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:26:09.223667 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-27b326f8-27a8-43b6-a929-8408bfbd750f tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] Calling method '.version_select at 0x7f217e1df2f0>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:09.303054 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-27b326f8-27a8-43b6-a929-8408bfbd750f tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] HTTP exception thrown: Snapshot b271d4ed-3743-4f0e-931a-b57da1dcbff3 could not be found. Feb 19 02:26:09.304077 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-27b326f8-27a8-43b6-a929-8408bfbd750f tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] Returning 404 to user: Snapshot b271d4ed-3743-4f0e-931a-b57da1dcbff3 could not be found. {{(pid=98194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:26:09.305193 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-27b326f8-27a8-43b6-a929-8408bfbd750f tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/b271d4ed-3743-4f0e-931a-b57da1dcbff3" status: 404 len: 111 microversion: 2.1 time: 0.085711 Feb 19 02:26:09.306828 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 8/12] 10.222.0.44 () {58 vars in 1241 bytes} [Fri Feb 19 02:26:09 2021] GET /compute/v2.1/os-snapshots/b271d4ed-3743-4f0e-931a-b57da1dcbff3 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 02:26:09.315150 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-bbaa4c95-c5fd-4f89-b64e-acde7c31f71a tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] Calling method '.version_select at 0x7f217e7192f0>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:09.443928 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-bbaa4c95-c5fd-4f89-b64e-acde7c31f71a tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/b7c353f4-a051-4b9d-936f-62fc4ce287b0" status: 202 len: 0 microversion: 2.1 time: 0.133331 Feb 19 02:26:09.445048 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 9/13] 10.222.0.44 () {58 vars in 1238 bytes} [Fri Feb 19 02:26:09 2021] DELETE /compute/v2.1/os-volumes/b7c353f4-a051-4b9d-936f-62fc4ce287b0 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:26:09.453988 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-6dc0e76d-1066-4393-8154-9f9d775a8aef tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] Calling method '.version_select at 0x7f217e19fea0>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:09.566185 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-6dc0e76d-1066-4393-8154-9f9d775a8aef tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/b7c353f4-a051-4b9d-936f-62fc4ce287b0" status: 200 len: 345 microversion: 2.1 time: 0.116200 Feb 19 02:26:09.567126 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 10/14] 10.222.0.44 () {58 vars in 1235 bytes} [Fri Feb 19 02:26:09 2021] GET /compute/v2.1/os-volumes/b7c353f4-a051-4b9d-936f-62fc4ce287b0 => generated 345 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:26:09.954878 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-a40dc0fe-89b1-4170-b0b4-f5b847871e93 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Flavor limits 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 02:26:09.955542 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-a40dc0fe-89b1-4170-b0b4-f5b847871e93 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Image limits 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 02:26:09.956228 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-a40dc0fe-89b1-4170-b0b4-f5b847871e93 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Flavor pref 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 02:26:09.956867 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-a40dc0fe-89b1-4170-b0b4-f5b847871e93 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Image pref 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 02:26:09.957508 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-a40dc0fe-89b1-4170-b0b4-f5b847871e93 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 02:26:09.977188 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a40dc0fe-89b1-4170-b0b4-f5b847871e93 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:09.981792 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a40dc0fe-89b1-4170-b0b4-f5b847871e93 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:09.983349 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a40dc0fe-89b1-4170-b0b4-f5b847871e93 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:09.984930 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a40dc0fe-89b1-4170-b0b4-f5b847871e93 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:10.041904 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-a40dc0fe-89b1-4170-b0b4-f5b847871e93 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Getting quotas for project c9d5cd11d3da467cafa26ca33bb4e830. Resources: {'ram', 'instances', 'cores'} {{(pid=98193) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:26:10.055579 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-a40dc0fe-89b1-4170-b0b4-f5b847871e93 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Getting quotas for user adfeeed90aa346138d8c1d8c87a25572 and project c9d5cd11d3da467cafa26ca33bb4e830. Resources: {'ram', 'instances', 'cores'} {{(pid=98193) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:26:10.083852 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a40dc0fe-89b1-4170-b0b4-f5b847871e93 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Going to run 1 instances... {{(pid=98193) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 02:26:10.089243 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a40dc0fe-89b1-4170-b0b4-f5b847871e93 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37a0f9d8-d3f7-417e-bce6-371e41a47c88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 02:26:10.257894 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a40dc0fe-89b1-4170-b0b4-f5b847871e93 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.224074 Feb 19 02:26:10.259092 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 5/15] 10.222.0.44 () {60 vars in 1137 bytes} [Fri Feb 19 02:26:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 3226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 02:26:10.273304 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5cba3314-b688-48e1-a810-f0b0cc5ab9fc tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:10.273977 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5cba3314-b688-48e1-a810-f0b0cc5ab9fc tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:10.460419 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-3ea38ea3-1461-420c-b440-c1840db86084 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1070474815", "imageRef": "37a0f9d8-d3f7-417e-bce6-371e41a47c88", "flavorRef": "452", "networks": [{"uuid": "fd54f352-2984-4a61-b9ca-5bbc66d3aa9f"}]}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:26:10.621549 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5cba3314-b688-48e1-a810-f0b0cc5ab9fc tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfeeed90aa346138d8c1d8c87a25572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d5cd11d3da467cafa26ca33bb4e830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:10.651629 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5cba3314-b688-48e1-a810-f0b0cc5ab9fc tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da" status: 200 len: 1215 microversion: 2.1 time: 0.383968 Feb 19 02:26:10.655886 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 6/16] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:10 2021] GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da => generated 1215 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:10.663068 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-3e5b66bd-658b-48f2-a8d9-fee6fc63a92d tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] Calling method '.version_select at 0x7f217dfe5ae8>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:10.663335 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-3ea38ea3-1461-420c-b440-c1840db86084 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] validate_networks() for [('fd54f352-2984-4a61-b9ca-5bbc66d3aa9f', None, None, None)] {{(pid=98194) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 02:26:10.868800 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-3e5b66bd-658b-48f2-a8d9-fee6fc63a92d tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] HTTP exception thrown: Volume b7c353f4-a051-4b9d-936f-62fc4ce287b0 could not be found. Feb 19 02:26:10.869581 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-3e5b66bd-658b-48f2-a8d9-fee6fc63a92d tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] Returning 404 to user: Volume b7c353f4-a051-4b9d-936f-62fc4ce287b0 could not be found. {{(pid=98193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:26:10.871126 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-3e5b66bd-658b-48f2-a8d9-fee6fc63a92d tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/b7c353f4-a051-4b9d-936f-62fc4ce287b0" status: 404 len: 109 microversion: 2.1 time: 0.213510 Feb 19 02:26:10.872701 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 7/17] 10.222.0.44 () {58 vars in 1235 bytes} [Fri Feb 19 02:26:10 2021] GET /compute/v2.1/os-volumes/b7c353f4-a051-4b9d-936f-62fc4ce287b0 => generated 109 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 02:26:10.905901 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1c17fd88-eb8e-45f3-9a74-d6c004f65f14 tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] Calling method '.version_select at 0x7f217d79c730>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:11.089897 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-1c17fd88-eb8e-45f3-9a74-d6c004f65f14 tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] HTTP exception thrown: Volume b7c353f4-a051-4b9d-936f-62fc4ce287b0 could not be found. Feb 19 02:26:11.091702 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1c17fd88-eb8e-45f3-9a74-d6c004f65f14 tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] Returning 404 to user: Volume b7c353f4-a051-4b9d-936f-62fc4ce287b0 could not be found. {{(pid=98193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:26:11.092982 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1c17fd88-eb8e-45f3-9a74-d6c004f65f14 tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/b7c353f4-a051-4b9d-936f-62fc4ce287b0" status: 404 len: 109 microversion: 2.1 time: 0.203926 Feb 19 02:26:11.094113 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 8/18] 10.222.0.44 () {58 vars in 1238 bytes} [Fri Feb 19 02:26:10 2021] DELETE /compute/v2.1/os-volumes/b7c353f4-a051-4b9d-936f-62fc4ce287b0 => generated 109 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 02:26:11.102904 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-11c09ab9-3b20-42dc-a76f-45e3fa3c18f1 tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] Calling method '.version_select at 0x7f217dfe5ea0>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:11.236623 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-11c09ab9-3b20-42dc-a76f-45e3fa3c18f1 tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] HTTP exception thrown: Volume b7c353f4-a051-4b9d-936f-62fc4ce287b0 could not be found. Feb 19 02:26:11.237296 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-11c09ab9-3b20-42dc-a76f-45e3fa3c18f1 tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] Returning 404 to user: Volume b7c353f4-a051-4b9d-936f-62fc4ce287b0 could not be found. {{(pid=98193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:26:11.239001 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-11c09ab9-3b20-42dc-a76f-45e3fa3c18f1 tempest-VolumesSnapshotsTestJSON-558180567 tempest-VolumesSnapshotsTestJSON-558180567-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/b7c353f4-a051-4b9d-936f-62fc4ce287b0" status: 404 len: 109 microversion: 2.1 time: 0.139997 Feb 19 02:26:11.239492 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 9/19] 10.222.0.44 () {58 vars in 1235 bytes} [Fri Feb 19 02:26:11 2021] GET /compute/v2.1/os-volumes/b7c353f4-a051-4b9d-936f-62fc4ce287b0 => generated 109 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 02:26:11.677696 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-27ebd1c4-4099-4635-be1a-7d5bad899108 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:11.678550 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-27ebd1c4-4099-4635-be1a-7d5bad899108 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:12.504974 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-27ebd1c4-4099-4635-be1a-7d5bad899108 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfeeed90aa346138d8c1d8c87a25572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d5cd11d3da467cafa26ca33bb4e830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:12.529632 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-27ebd1c4-4099-4635-be1a-7d5bad899108 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da" status: 200 len: 1215 microversion: 2.1 time: 0.858542 Feb 19 02:26:12.543957 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 10/20] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:11 2021] GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da => generated 1215 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:13.561316 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-aed41cc7-c954-4667-8738-7246903961f2 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:13.561796 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-aed41cc7-c954-4667-8738-7246903961f2 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:13.581283 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-aed41cc7-c954-4667-8738-7246903961f2 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:13.594234 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-aed41cc7-c954-4667-8738-7246903961f2 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:13.598413 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-aed41cc7-c954-4667-8738-7246903961f2 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:13.604113 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-aed41cc7-c954-4667-8738-7246903961f2 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:14.112696 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-aed41cc7-c954-4667-8738-7246903961f2 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfeeed90aa346138d8c1d8c87a25572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d5cd11d3da467cafa26ca33bb4e830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:14.131514 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-aed41cc7-c954-4667-8738-7246903961f2 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da" status: 200 len: 1285 microversion: 2.1 time: 0.580582 Feb 19 02:26:14.142384 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 11/21] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:13 2021] GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da => generated 1285 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:15.152567 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b02dad3c-42c8-4d62-9511-8cefd7bbd3dd tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:15.154436 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b02dad3c-42c8-4d62-9511-8cefd7bbd3dd tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:15.171784 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b02dad3c-42c8-4d62-9511-8cefd7bbd3dd tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:15.172545 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b02dad3c-42c8-4d62-9511-8cefd7bbd3dd tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:15.173542 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b02dad3c-42c8-4d62-9511-8cefd7bbd3dd tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:15.174176 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b02dad3c-42c8-4d62-9511-8cefd7bbd3dd tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:16.090910 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b02dad3c-42c8-4d62-9511-8cefd7bbd3dd tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfeeed90aa346138d8c1d8c87a25572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d5cd11d3da467cafa26ca33bb4e830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:16.104510 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b02dad3c-42c8-4d62-9511-8cefd7bbd3dd tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da" status: 200 len: 1273 microversion: 2.1 time: 0.956089 Feb 19 02:26:16.107963 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 12/22] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:15 2021] GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da => generated 1273 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:26:17.129581 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a7235d74-94f9-4719-b7f3-1f8488dadbf5 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:17.130950 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a7235d74-94f9-4719-b7f3-1f8488dadbf5 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:17.148520 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a7235d74-94f9-4719-b7f3-1f8488dadbf5 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:17.149809 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a7235d74-94f9-4719-b7f3-1f8488dadbf5 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:17.151340 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a7235d74-94f9-4719-b7f3-1f8488dadbf5 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:17.164649 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a7235d74-94f9-4719-b7f3-1f8488dadbf5 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:17.520166 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a7235d74-94f9-4719-b7f3-1f8488dadbf5 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfeeed90aa346138d8c1d8c87a25572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d5cd11d3da467cafa26ca33bb4e830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:17.578130 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a7235d74-94f9-4719-b7f3-1f8488dadbf5 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da" status: 200 len: 1273 microversion: 2.1 time: 0.445040 Feb 19 02:26:17.578986 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 13/23] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:17 2021] GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da => generated 1273 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:18.598401 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7703fe7a-5053-40a6-90b1-6be8a02eab9f tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:18.599743 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7703fe7a-5053-40a6-90b1-6be8a02eab9f tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:18.617367 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7703fe7a-5053-40a6-90b1-6be8a02eab9f tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:18.618343 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7703fe7a-5053-40a6-90b1-6be8a02eab9f tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:18.619894 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7703fe7a-5053-40a6-90b1-6be8a02eab9f tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:18.620590 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7703fe7a-5053-40a6-90b1-6be8a02eab9f tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:19.183680 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7703fe7a-5053-40a6-90b1-6be8a02eab9f tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfeeed90aa346138d8c1d8c87a25572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d5cd11d3da467cafa26ca33bb4e830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:19.202962 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7703fe7a-5053-40a6-90b1-6be8a02eab9f tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da" status: 200 len: 1273 microversion: 2.1 time: 0.608521 Feb 19 02:26:19.228565 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 14/24] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:18 2021] GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da => generated 1273 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:19.237150 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-3ea38ea3-1461-420c-b440-c1840db86084 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Flavor limits 0:0:0 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 02:26:19.237641 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-3ea38ea3-1461-420c-b440-c1840db86084 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Image limits 0:0:0 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 02:26:19.238183 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-3ea38ea3-1461-420c-b440-c1840db86084 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Flavor pref 0:0:0 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 02:26:19.238718 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-3ea38ea3-1461-420c-b440-c1840db86084 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Image pref 0:0:0 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 02:26:19.277554 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-3ea38ea3-1461-420c-b440-c1840db86084 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 02:26:19.300816 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3ea38ea3-1461-420c-b440-c1840db86084 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:19.301479 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3ea38ea3-1461-420c-b440-c1840db86084 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:19.308720 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3ea38ea3-1461-420c-b440-c1840db86084 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:19.308987 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3ea38ea3-1461-420c-b440-c1840db86084 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:19.392716 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-3ea38ea3-1461-420c-b440-c1840db86084 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Getting quotas for project bf138e653b034c909eb38d6f109c2c4b. Resources: {'ram', 'instances', 'cores'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:26:19.398932 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-3ea38ea3-1461-420c-b440-c1840db86084 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Getting quotas for user 50e5a3cbcd6e4b73badbf6ca8db58941 and project bf138e653b034c909eb38d6f109c2c4b. Resources: {'ram', 'instances', 'cores'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:26:19.427555 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-3ea38ea3-1461-420c-b440-c1840db86084 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Going to run 1 instances... {{(pid=98194) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 02:26:19.431230 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-3ea38ea3-1461-420c-b440-c1840db86084 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f4cde0d9-bb04-4e83-bc35-22f026ead5da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37a0f9d8-d3f7-417e-bce6-371e41a47c88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 02:26:19.559431 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-3ea38ea3-1461-420c-b440-c1840db86084 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.324365 Feb 19 02:26:19.560507 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 11/25] 10.222.0.44 () {60 vars in 1137 bytes} [Fri Feb 19 02:26:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 9326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 02:26:19.576992 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-117b054a-2a58-41a4-beb5-bb75a7789f9e tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:19.578019 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-117b054a-2a58-41a4-beb5-bb75a7789f9e tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f4cde0d9-bb04-4e83-bc35-22f026ead5da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:20.031845 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-117b054a-2a58-41a4-beb5-bb75a7789f9e tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:20.044872 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-117b054a-2a58-41a4-beb5-bb75a7789f9e tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da" status: 200 len: 1218 microversion: 2.1 time: 0.472464 Feb 19 02:26:20.052072 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 15/26] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:19 2021] GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da => generated 1218 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:20.247547 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ae6eb704-fa91-4c25-a307-6302240d629a tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:20.248274 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ae6eb704-fa91-4c25-a307-6302240d629a tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:20.274455 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ae6eb704-fa91-4c25-a307-6302240d629a tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:20.275198 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ae6eb704-fa91-4c25-a307-6302240d629a tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:20.276218 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ae6eb704-fa91-4c25-a307-6302240d629a tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:20.276857 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ae6eb704-fa91-4c25-a307-6302240d629a tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:21.066186 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c8864bec-7bd4-4363-89fc-2bc0bc87d880 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:21.067535 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c8864bec-7bd4-4363-89fc-2bc0bc87d880 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f4cde0d9-bb04-4e83-bc35-22f026ead5da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:21.338134 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c8864bec-7bd4-4363-89fc-2bc0bc87d880 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:21.367211 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c8864bec-7bd4-4363-89fc-2bc0bc87d880 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da" status: 200 len: 1218 microversion: 2.1 time: 0.292582 Feb 19 02:26:21.368147 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 16/27] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:21 2021] GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da => generated 1218 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:21.441449 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ae6eb704-fa91-4c25-a307-6302240d629a tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfeeed90aa346138d8c1d8c87a25572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d5cd11d3da467cafa26ca33bb4e830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:21.484130 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ae6eb704-fa91-4c25-a307-6302240d629a tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da" status: 200 len: 1273 microversion: 2.1 time: 1.252046 Feb 19 02:26:21.488834 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 12/28] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:20 2021] GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da => generated 1273 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:22.392251 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5192e29c-99df-4b10-9db8-1d02692f7dea tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:22.393077 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5192e29c-99df-4b10-9db8-1d02692f7dea tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f4cde0d9-bb04-4e83-bc35-22f026ead5da] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:22.435015 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5192e29c-99df-4b10-9db8-1d02692f7dea tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:22.435498 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5192e29c-99df-4b10-9db8-1d02692f7dea tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:22.436440 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5192e29c-99df-4b10-9db8-1d02692f7dea tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:22.436964 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5192e29c-99df-4b10-9db8-1d02692f7dea tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:22.472193 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-85abdb64-5a9e-42fb-b638-7b61ffffcf8f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1520470640", "imageRef": "37a0f9d8-d3f7-417e-bce6-371e41a47c88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "acfca0d0-da8f-403c-9e50-a374c5e591ce"}]}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:26:22.756734 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-85abdb64-5a9e-42fb-b638-7b61ffffcf8f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] validate_networks() for [('acfca0d0-da8f-403c-9e50-a374c5e591ce', None, None, None)] {{(pid=98193) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 02:26:24.233721 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5192e29c-99df-4b10-9db8-1d02692f7dea tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:24.251047 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5192e29c-99df-4b10-9db8-1d02692f7dea tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da" status: 200 len: 1214 microversion: 2.1 time: 1.868330 Feb 19 02:26:24.255099 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 13/29] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:22 2021] GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da => generated 1214 bytes in 1874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:24.274809 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a128633e-287c-4ecf-9c55-2ae2c7a7277f tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:24.278744 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a128633e-287c-4ecf-9c55-2ae2c7a7277f tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:24.312660 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a128633e-287c-4ecf-9c55-2ae2c7a7277f tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:24.319232 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a128633e-287c-4ecf-9c55-2ae2c7a7277f tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:24.320977 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a128633e-287c-4ecf-9c55-2ae2c7a7277f tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:24.321478 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a128633e-287c-4ecf-9c55-2ae2c7a7277f tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:24.714787 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a128633e-287c-4ecf-9c55-2ae2c7a7277f tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfeeed90aa346138d8c1d8c87a25572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d5cd11d3da467cafa26ca33bb4e830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:24.747187 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a128633e-287c-4ecf-9c55-2ae2c7a7277f tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da" status: 200 len: 1273 microversion: 2.1 time: 0.475299 Feb 19 02:26:24.748578 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 14/30] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:24 2021] GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da => generated 1273 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:24.934545 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-85abdb64-5a9e-42fb-b638-7b61ffffcf8f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Flavor limits 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 02:26:24.935197 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-85abdb64-5a9e-42fb-b638-7b61ffffcf8f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Image limits 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 02:26:24.936470 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-85abdb64-5a9e-42fb-b638-7b61ffffcf8f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Flavor pref 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 02:26:24.937044 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-85abdb64-5a9e-42fb-b638-7b61ffffcf8f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Image pref 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 02:26:24.937638 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-85abdb64-5a9e-42fb-b638-7b61ffffcf8f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 02:26:24.956851 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-85abdb64-5a9e-42fb-b638-7b61ffffcf8f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:24.957567 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-85abdb64-5a9e-42fb-b638-7b61ffffcf8f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:24.960235 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-85abdb64-5a9e-42fb-b638-7b61ffffcf8f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:24.962011 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-85abdb64-5a9e-42fb-b638-7b61ffffcf8f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:25.031113 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-85abdb64-5a9e-42fb-b638-7b61ffffcf8f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Getting quotas for project 9bdc6eeb362640cd96dab7841d609efa. Resources: {'ram', 'instances', 'cores'} {{(pid=98193) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:26:25.043893 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-85abdb64-5a9e-42fb-b638-7b61ffffcf8f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Getting quotas for user dfa75e601e4640da9444d14362d021a6 and project 9bdc6eeb362640cd96dab7841d609efa. Resources: {'ram', 'instances', 'cores'} {{(pid=98193) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:26:25.071470 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-85abdb64-5a9e-42fb-b638-7b61ffffcf8f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Going to run 1 instances... {{(pid=98193) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 02:26:25.074967 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-85abdb64-5a9e-42fb-b638-7b61ffffcf8f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37a0f9d8-d3f7-417e-bce6-371e41a47c88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 02:26:25.165478 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-85abdb64-5a9e-42fb-b638-7b61ffffcf8f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.535829 Feb 19 02:26:25.166473 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 17/31] 10.222.0.44 () {60 vars in 1137 bytes} [Fri Feb 19 02:26:21 2021] POST /compute/v2.1/servers => generated 383 bytes in 3539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 02:26:25.180118 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7bbd4c52-9a96-480b-b3b2-30f9d2ab204e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:25.181624 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7bbd4c52-9a96-480b-b3b2-30f9d2ab204e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:25.274754 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-122bb8e6-b383-42cb-817f-e06453e956a3 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:25.275443 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-122bb8e6-b383-42cb-817f-e06453e956a3 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f4cde0d9-bb04-4e83-bc35-22f026ead5da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:25.297291 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-122bb8e6-b383-42cb-817f-e06453e956a3 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:25.297805 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-122bb8e6-b383-42cb-817f-e06453e956a3 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:25.301359 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-122bb8e6-b383-42cb-817f-e06453e956a3 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:25.301870 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-122bb8e6-b383-42cb-817f-e06453e956a3 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:25.587337 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-122bb8e6-b383-42cb-817f-e06453e956a3 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:25.611473 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-122bb8e6-b383-42cb-817f-e06453e956a3 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da" status: 200 len: 1276 microversion: 2.1 time: 0.339466 Feb 19 02:26:25.613597 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 18/32] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:25 2021] GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da => generated 1276 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:25.767994 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-170eab8e-b642-496e-a3f6-701a7a5e9ff1 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:25.769124 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-170eab8e-b642-496e-a3f6-701a7a5e9ff1 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:25.793936 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-170eab8e-b642-496e-a3f6-701a7a5e9ff1 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:25.795040 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-170eab8e-b642-496e-a3f6-701a7a5e9ff1 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:25.796436 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-170eab8e-b642-496e-a3f6-701a7a5e9ff1 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:25.800345 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-170eab8e-b642-496e-a3f6-701a7a5e9ff1 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:25.826858 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7bbd4c52-9a96-480b-b3b2-30f9d2ab204e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:25.847285 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7bbd4c52-9a96-480b-b3b2-30f9d2ab204e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1222 microversion: 2.1 time: 0.672098 Feb 19 02:26:25.858400 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 15/33] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:25 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1222 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:26.112748 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-170eab8e-b642-496e-a3f6-701a7a5e9ff1 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfeeed90aa346138d8c1d8c87a25572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d5cd11d3da467cafa26ca33bb4e830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:26.126065 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-170eab8e-b642-496e-a3f6-701a7a5e9ff1 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da" status: 200 len: 1273 microversion: 2.1 time: 0.363906 Feb 19 02:26:26.126718 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 19/34] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:25 2021] GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da => generated 1273 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:26.130989 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-291b9749-56b5-4966-b8ee-608b73fbe31b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-649508973", "imageRef": "37a0f9d8-d3f7-417e-bce6-371e41a47c88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "acfca0d0-da8f-403c-9e50-a374c5e591ce"}]}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:26:26.313387 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-291b9749-56b5-4966-b8ee-608b73fbe31b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] validate_networks() for [('acfca0d0-da8f-403c-9e50-a374c5e591ce', None, None, None)] {{(pid=98194) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 02:26:26.633384 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-24e84ac7-3cd7-4d1b-aea3-2e431256a848 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:26.634384 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-24e84ac7-3cd7-4d1b-aea3-2e431256a848 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f4cde0d9-bb04-4e83-bc35-22f026ead5da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:26.653479 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-24e84ac7-3cd7-4d1b-aea3-2e431256a848 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:26.654005 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-24e84ac7-3cd7-4d1b-aea3-2e431256a848 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:26.655749 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-24e84ac7-3cd7-4d1b-aea3-2e431256a848 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:26.655749 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-24e84ac7-3cd7-4d1b-aea3-2e431256a848 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:27.071544 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-24e84ac7-3cd7-4d1b-aea3-2e431256a848 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:27.092185 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-24e84ac7-3cd7-4d1b-aea3-2e431256a848 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da" status: 200 len: 1276 microversion: 2.1 time: 0.463911 Feb 19 02:26:27.092830 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 20/35] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:26 2021] GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da => generated 1276 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:27.145208 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5eefcebe-d533-41f3-bffd-2d0bd6cf5aee tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:27.146102 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5eefcebe-d533-41f3-bffd-2d0bd6cf5aee tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:27.178071 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5eefcebe-d533-41f3-bffd-2d0bd6cf5aee tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:27.183793 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5eefcebe-d533-41f3-bffd-2d0bd6cf5aee tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:27.187312 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5eefcebe-d533-41f3-bffd-2d0bd6cf5aee tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:27.188264 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5eefcebe-d533-41f3-bffd-2d0bd6cf5aee tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:28.037763 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5eefcebe-d533-41f3-bffd-2d0bd6cf5aee tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfeeed90aa346138d8c1d8c87a25572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d5cd11d3da467cafa26ca33bb4e830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:28.054859 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5eefcebe-d533-41f3-bffd-2d0bd6cf5aee tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da" status: 200 len: 1315 microversion: 2.1 time: 0.914253 Feb 19 02:26:28.061163 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 21/36] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:27 2021] GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da => generated 1315 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:26:28.111715 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ea1c525a-d4c5-49b3-9522-f78b5eeb5727 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:28.113082 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ea1c525a-d4c5-49b3-9522-f78b5eeb5727 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f4cde0d9-bb04-4e83-bc35-22f026ead5da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:28.135705 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ea1c525a-d4c5-49b3-9522-f78b5eeb5727 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:28.136252 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ea1c525a-d4c5-49b3-9522-f78b5eeb5727 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:28.137647 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ea1c525a-d4c5-49b3-9522-f78b5eeb5727 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:28.138136 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ea1c525a-d4c5-49b3-9522-f78b5eeb5727 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:29.437036 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ea1c525a-d4c5-49b3-9522-f78b5eeb5727 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:29.456033 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ea1c525a-d4c5-49b3-9522-f78b5eeb5727 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da" status: 200 len: 1276 microversion: 2.1 time: 1.348796 Feb 19 02:26:29.462690 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 22/37] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:28 2021] GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da => generated 1276 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:29.476973 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a4d368fa-c2a3-4120-8cad-aef8761bf9c8 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:29.478125 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a4d368fa-c2a3-4120-8cad-aef8761bf9c8 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:29.525192 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a4d368fa-c2a3-4120-8cad-aef8761bf9c8 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:29.526076 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a4d368fa-c2a3-4120-8cad-aef8761bf9c8 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:29.528192 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a4d368fa-c2a3-4120-8cad-aef8761bf9c8 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:29.529099 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a4d368fa-c2a3-4120-8cad-aef8761bf9c8 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:30.244114 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a4d368fa-c2a3-4120-8cad-aef8761bf9c8 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfeeed90aa346138d8c1d8c87a25572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d5cd11d3da467cafa26ca33bb4e830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:30.257871 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a4d368fa-c2a3-4120-8cad-aef8761bf9c8 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da" status: 200 len: 1315 microversion: 2.1 time: 0.793564 Feb 19 02:26:30.258539 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 23/38] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:29 2021] GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da => generated 1315 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:30.478034 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-acb63d47-e23b-485e-90cf-b53cb09d9d6a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:30.479371 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-acb63d47-e23b-485e-90cf-b53cb09d9d6a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f4cde0d9-bb04-4e83-bc35-22f026ead5da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:30.489834 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-acb63d47-e23b-485e-90cf-b53cb09d9d6a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:30.494304 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-acb63d47-e23b-485e-90cf-b53cb09d9d6a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:30.495813 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-acb63d47-e23b-485e-90cf-b53cb09d9d6a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:30.497442 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-acb63d47-e23b-485e-90cf-b53cb09d9d6a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:31.357007 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-acb63d47-e23b-485e-90cf-b53cb09d9d6a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:31.416512 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-acb63d47-e23b-485e-90cf-b53cb09d9d6a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da" status: 200 len: 1318 microversion: 2.1 time: 0.937281 Feb 19 02:26:31.417496 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 24/39] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:30 2021] GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da => generated 1318 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:31.436344 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d189d1bd-dc7a-41f4-8788-67ce57ab265d tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:31.437836 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d189d1bd-dc7a-41f4-8788-67ce57ab265d tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:31.456486 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d189d1bd-dc7a-41f4-8788-67ce57ab265d tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:31.456996 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d189d1bd-dc7a-41f4-8788-67ce57ab265d tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:31.457863 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d189d1bd-dc7a-41f4-8788-67ce57ab265d tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:31.458396 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d189d1bd-dc7a-41f4-8788-67ce57ab265d tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:31.788984 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-d189d1bd-dc7a-41f4-8788-67ce57ab265d tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfeeed90aa346138d8c1d8c87a25572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d5cd11d3da467cafa26ca33bb4e830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:31.804878 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d189d1bd-dc7a-41f4-8788-67ce57ab265d tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da" status: 200 len: 1315 microversion: 2.1 time: 0.376759 Feb 19 02:26:31.806472 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 25/40] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:31 2021] GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:32.241987 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-291b9749-56b5-4966-b8ee-608b73fbe31b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Flavor limits 0:0:0 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 02:26:32.242503 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-291b9749-56b5-4966-b8ee-608b73fbe31b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Image limits 0:0:0 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 02:26:32.243051 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-291b9749-56b5-4966-b8ee-608b73fbe31b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Flavor pref 0:0:0 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 02:26:32.243509 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-291b9749-56b5-4966-b8ee-608b73fbe31b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Image pref 0:0:0 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 02:26:32.243970 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-291b9749-56b5-4966-b8ee-608b73fbe31b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 02:26:32.254778 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-291b9749-56b5-4966-b8ee-608b73fbe31b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:32.255285 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-291b9749-56b5-4966-b8ee-608b73fbe31b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:32.256171 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-291b9749-56b5-4966-b8ee-608b73fbe31b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:32.256638 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-291b9749-56b5-4966-b8ee-608b73fbe31b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:32.277632 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-291b9749-56b5-4966-b8ee-608b73fbe31b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Getting quotas for project 9bdc6eeb362640cd96dab7841d609efa. Resources: {'ram', 'instances', 'cores'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:26:32.282995 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-291b9749-56b5-4966-b8ee-608b73fbe31b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Getting quotas for user dfa75e601e4640da9444d14362d021a6 and project 9bdc6eeb362640cd96dab7841d609efa. Resources: {'ram', 'instances', 'cores'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:26:32.295201 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-291b9749-56b5-4966-b8ee-608b73fbe31b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Going to run 1 instances... {{(pid=98194) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 02:26:32.298420 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-291b9749-56b5-4966-b8ee-608b73fbe31b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37a0f9d8-d3f7-417e-bce6-371e41a47c88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 02:26:32.358495 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-291b9749-56b5-4966-b8ee-608b73fbe31b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.231973 Feb 19 02:26:32.364872 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 16/41] 10.222.0.44 () {60 vars in 1137 bytes} [Fri Feb 19 02:26:26 2021] POST /compute/v2.1/servers => generated 383 bytes in 6237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 02:26:32.371913 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-57e48617-75b0-4c7d-a2d6-908b8563a177 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:32.372970 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-57e48617-75b0-4c7d-a2d6-908b8563a177 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:32.436936 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7def816a-413d-4890-87db-9485a71e9813 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:32.438025 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7def816a-413d-4890-87db-9485a71e9813 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f4cde0d9-bb04-4e83-bc35-22f026ead5da] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:32.447140 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7def816a-413d-4890-87db-9485a71e9813 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:32.447976 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7def816a-413d-4890-87db-9485a71e9813 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:32.449319 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7def816a-413d-4890-87db-9485a71e9813 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:32.450298 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7def816a-413d-4890-87db-9485a71e9813 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:32.511998 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-57e48617-75b0-4c7d-a2d6-908b8563a177 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:32.523581 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-57e48617-75b0-4c7d-a2d6-908b8563a177 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1221 microversion: 2.1 time: 0.156268 Feb 19 02:26:32.538830 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 26/42] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:32 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1221 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:26:32.826702 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e0289332-4797-4bab-9371-add40d4b5d30 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:32.828724 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e0289332-4797-4bab-9371-add40d4b5d30 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:32.838450 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e0289332-4797-4bab-9371-add40d4b5d30 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:32.839662 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e0289332-4797-4bab-9371-add40d4b5d30 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:32.840728 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e0289332-4797-4bab-9371-add40d4b5d30 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:32.841441 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e0289332-4797-4bab-9371-add40d4b5d30 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:33.661076 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7def816a-413d-4890-87db-9485a71e9813 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:33.682018 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7def816a-413d-4890-87db-9485a71e9813 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da" status: 200 len: 1318 microversion: 2.1 time: 1.250156 Feb 19 02:26:33.686716 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 17/43] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:32 2021] GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da => generated 1318 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:26:33.698721 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-48ce4a28-f9d8-47c3-acdb-d2981e43cde8 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:33.701034 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-48ce4a28-f9d8-47c3-acdb-d2981e43cde8 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:33.723776 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-48ce4a28-f9d8-47c3-acdb-d2981e43cde8 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:33.724632 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-48ce4a28-f9d8-47c3-acdb-d2981e43cde8 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:33.726721 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-48ce4a28-f9d8-47c3-acdb-d2981e43cde8 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:33.729887 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-48ce4a28-f9d8-47c3-acdb-d2981e43cde8 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:33.844306 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e0289332-4797-4bab-9371-add40d4b5d30 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfeeed90aa346138d8c1d8c87a25572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d5cd11d3da467cafa26ca33bb4e830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:33.870985 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e0289332-4797-4bab-9371-add40d4b5d30 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da" status: 200 len: 1315 microversion: 2.1 time: 1.034815 Feb 19 02:26:33.888270 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 27/44] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:32 2021] GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da => generated 1315 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:34.163442 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-dfa71228-44ae-4338-9261-a5b941e3f9ff tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'create', calling method: .version_select at 0x7f217d79cbf8>, body: {"keypair": {"name": "tempest-keypair-588318548"}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:26:34.255057 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-dfa71228-44ae-4338-9261-a5b941e3f9ff tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Getting quotas for project c5e1c746a8dc450eb96f1b22cd181e50. Resources: {'key_pairs'} {{(pid=98193) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:26:34.267619 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-dfa71228-44ae-4338-9261-a5b941e3f9ff tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Getting quotas for user 485c785ecc8b41ffa4a9b1e908cb5145 and project c5e1c746a8dc450eb96f1b22cd181e50. Resources: {'key_pairs'} {{(pid=98193) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:26:35.078721 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-dfa71228-44ae-4338-9261-a5b941e3f9ff tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Getting quotas for project c5e1c746a8dc450eb96f1b22cd181e50. Resources: {'key_pairs'} {{(pid=98193) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:26:35.087664 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-dfa71228-44ae-4338-9261-a5b941e3f9ff tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Getting quotas for user 485c785ecc8b41ffa4a9b1e908cb5145 and project c5e1c746a8dc450eb96f1b22cd181e50. Resources: {'key_pairs'} {{(pid=98193) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:26:35.117963 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-dfa71228-44ae-4338-9261-a5b941e3f9ff tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.227089 Feb 19 02:26:35.125939 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 28/45] 10.222.0.44 () {62 vars in 1189 bytes} [Fri Feb 19 02:26:33 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1237 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 19 02:26:35.131303 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ef25395a-f0ce-4738-9c31-6c4b8d46a6f9 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:35.131966 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ef25395a-f0ce-4738-9c31-6c4b8d46a6f9 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f4cde0d9-bb04-4e83-bc35-22f026ead5da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:35.155825 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ef25395a-f0ce-4738-9c31-6c4b8d46a6f9 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:35.175139 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ef25395a-f0ce-4738-9c31-6c4b8d46a6f9 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:35.178339 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ef25395a-f0ce-4738-9c31-6c4b8d46a6f9 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:35.179015 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ef25395a-f0ce-4738-9c31-6c4b8d46a6f9 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:35.283973 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-48ce4a28-f9d8-47c3-acdb-d2981e43cde8 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:35.295839 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-48ce4a28-f9d8-47c3-acdb-d2981e43cde8 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1273 microversion: 2.1 time: 1.606796 Feb 19 02:26:35.296442 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 18/46] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:33 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1273 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:35.310799 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-88df2510-0c75-4e08-b995-5bf5924a778a tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:35.311695 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-88df2510-0c75-4e08-b995-5bf5924a778a tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:35.348296 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-88df2510-0c75-4e08-b995-5bf5924a778a tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:35.348808 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-88df2510-0c75-4e08-b995-5bf5924a778a tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:35.349678 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-88df2510-0c75-4e08-b995-5bf5924a778a tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:35.350176 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-88df2510-0c75-4e08-b995-5bf5924a778a tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:36.406872 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ef25395a-f0ce-4738-9c31-6c4b8d46a6f9 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:36.417172 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ef25395a-f0ce-4738-9c31-6c4b8d46a6f9 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da" status: 200 len: 1318 microversion: 2.1 time: 1.289782 Feb 19 02:26:36.418709 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 29/47] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:35 2021] GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da => generated 1318 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:36.435437 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d7fa0f41-52b1-4867-b85c-d7ec26d63ffb tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:36.436437 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d7fa0f41-52b1-4867-b85c-d7ec26d63ffb tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:36.446556 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d7fa0f41-52b1-4867-b85c-d7ec26d63ffb tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:36.447414 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d7fa0f41-52b1-4867-b85c-d7ec26d63ffb tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:36.451823 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d7fa0f41-52b1-4867-b85c-d7ec26d63ffb tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:36.452655 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d7fa0f41-52b1-4867-b85c-d7ec26d63ffb tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:36.671057 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-88df2510-0c75-4e08-b995-5bf5924a778a tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfeeed90aa346138d8c1d8c87a25572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d5cd11d3da467cafa26ca33bb4e830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:36.679986 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-88df2510-0c75-4e08-b995-5bf5924a778a tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da" status: 200 len: 1315 microversion: 2.1 time: 1.381965 Feb 19 02:26:36.684697 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 19/48] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:35 2021] GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da => generated 1315 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:36.711879 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-d7fa0f41-52b1-4867-b85c-d7ec26d63ffb tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:36.727744 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d7fa0f41-52b1-4867-b85c-d7ec26d63ffb tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1279 microversion: 2.1 time: 0.297282 Feb 19 02:26:36.732687 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 30/49] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:36 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1279 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:37.437292 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8f59bcf9-f457-4a21-8949-0af8e2fb69fc tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:37.438582 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8f59bcf9-f457-4a21-8949-0af8e2fb69fc tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f4cde0d9-bb04-4e83-bc35-22f026ead5da] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:37.448021 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8f59bcf9-f457-4a21-8949-0af8e2fb69fc tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:37.448780 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8f59bcf9-f457-4a21-8949-0af8e2fb69fc tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:37.450477 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8f59bcf9-f457-4a21-8949-0af8e2fb69fc tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:37.451169 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8f59bcf9-f457-4a21-8949-0af8e2fb69fc tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:37.704225 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-caf91144-9f04-4904-9211-585d75b050c9 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:37.704907 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-caf91144-9f04-4904-9211-585d75b050c9 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:37.721199 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-caf91144-9f04-4904-9211-585d75b050c9 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:37.721708 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-caf91144-9f04-4904-9211-585d75b050c9 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:37.726505 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-caf91144-9f04-4904-9211-585d75b050c9 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:37.727059 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-caf91144-9f04-4904-9211-585d75b050c9 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:38.396290 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-caf91144-9f04-4904-9211-585d75b050c9 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfeeed90aa346138d8c1d8c87a25572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d5cd11d3da467cafa26ca33bb4e830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:38.415435 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-caf91144-9f04-4904-9211-585d75b050c9 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da" status: 200 len: 1315 microversion: 2.1 time: 0.716382 Feb 19 02:26:38.417008 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 31/50] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:37 2021] GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da => generated 1315 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:38.424583 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-984427aa-4687-42fa-ac24-6ff74fd50b0e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:38.425947 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-984427aa-4687-42fa-ac24-6ff74fd50b0e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:38.437973 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-984427aa-4687-42fa-ac24-6ff74fd50b0e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:38.440090 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-984427aa-4687-42fa-ac24-6ff74fd50b0e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:38.441755 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-984427aa-4687-42fa-ac24-6ff74fd50b0e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:38.442474 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-984427aa-4687-42fa-ac24-6ff74fd50b0e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:38.475454 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8f59bcf9-f457-4a21-8949-0af8e2fb69fc tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:38.485847 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8f59bcf9-f457-4a21-8949-0af8e2fb69fc tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da" status: 200 len: 1318 microversion: 2.1 time: 1.053329 Feb 19 02:26:38.486506 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 20/51] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:37 2021] GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da => generated 1318 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:38.637555 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-2140a285-9fd2-4a2b-893d-54836ae2dc0f req-5f75e9cb-d450-43d6-82ea-d3a95e695432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4cde0d9-bb04-4e83-bc35-22f026ead5da", "tag": "bc9c2baf-39ce-43cd-95df-a8bcd7ed3497"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:26:38.640400 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:26:38.640400 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:26:38.651079 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-2140a285-9fd2-4a2b-893d-54836ae2dc0f req-5f75e9cb-d450-43d6-82ea-d3a95e695432 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:38.651997 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-2140a285-9fd2-4a2b-893d-54836ae2dc0f req-5f75e9cb-d450-43d6-82ea-d3a95e695432 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:38.676242 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-2140a285-9fd2-4a2b-893d-54836ae2dc0f req-5f75e9cb-d450-43d6-82ea-d3a95e695432 service nova] Creating event network-changed:bc9c2baf-39ce-43cd-95df-a8bcd7ed3497 for instance f4cde0d9-bb04-4e83-bc35-22f026ead5da on hv-cinder-77642 Feb 19 02:26:38.677167 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-2140a285-9fd2-4a2b-893d-54836ae2dc0f req-5f75e9cb-d450-43d6-82ea-d3a95e695432 service nova] Acquired lock "compute-rpcapi-router" {{(pid=98194) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 19 02:26:38.678669 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-da4e2e28-862f-4d6d-add5-139d953308b4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:38.679390 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-da4e2e28-862f-4d6d-add5-139d953308b4 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:38.680456 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-da4e2e28-862f-4d6d-add5-139d953308b4 None None] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:38.681143 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-da4e2e28-862f-4d6d-add5-139d953308b4 None None] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:38.693006 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.compute.rpcapi [None req-da4e2e28-862f-4d6d-add5-139d953308b4 None None] Automatically selected compute RPC version 5.13 from minimum service version 54 Feb 19 02:26:38.694228 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-da4e2e28-862f-4d6d-add5-139d953308b4 None None] Releasing lock "compute-rpcapi-router" {{(pid=98194) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 19 02:26:38.738396 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-da4e2e28-862f-4d6d-add5-139d953308b4 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.249370 Feb 19 02:26:38.740543 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 21/52] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:26:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:26:38.820109 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-ff997ace-d583-4d1f-9237-27f8e58e5f0e req-d6cf1ad1-adfe-4166-aed9-806d255f3b0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e5b207a-9887-4414-9e31-577bab1ff7da", "tag": "539d7478-42da-4489-996c-fb72328e93ff"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:26:38.821715 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:26:38.821715 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:26:38.833669 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-ff997ace-d583-4d1f-9237-27f8e58e5f0e req-d6cf1ad1-adfe-4166-aed9-806d255f3b0e service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:38.834473 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-ff997ace-d583-4d1f-9237-27f8e58e5f0e req-d6cf1ad1-adfe-4166-aed9-806d255f3b0e service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:38.856611 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-ff997ace-d583-4d1f-9237-27f8e58e5f0e req-d6cf1ad1-adfe-4166-aed9-806d255f3b0e service nova] Creating event network-changed:539d7478-42da-4489-996c-fb72328e93ff for instance 7e5b207a-9887-4414-9e31-577bab1ff7da on hv-cinder-77642 Feb 19 02:26:38.862395 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-ff997ace-d583-4d1f-9237-27f8e58e5f0e req-d6cf1ad1-adfe-4166-aed9-806d255f3b0e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119568 Feb 19 02:26:38.863310 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 22/53] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:26:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:26:39.238651 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-984427aa-4687-42fa-ac24-6ff74fd50b0e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:39.257050 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-984427aa-4687-42fa-ac24-6ff74fd50b0e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1321 microversion: 2.1 time: 0.837923 Feb 19 02:26:39.260141 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 32/54] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:38 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1321 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:39.439308 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1d66cded-e5e4-4af8-a0ac-3a605a1b5030 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:39.445410 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1d66cded-e5e4-4af8-a0ac-3a605a1b5030 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:39.465788 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1d66cded-e5e4-4af8-a0ac-3a605a1b5030 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:39.469944 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1d66cded-e5e4-4af8-a0ac-3a605a1b5030 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:39.471008 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1d66cded-e5e4-4af8-a0ac-3a605a1b5030 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:39.472644 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1d66cded-e5e4-4af8-a0ac-3a605a1b5030 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:39.522495 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8ce68e67-c2b7-400a-8a8f-d714474634c7 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:39.526098 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8ce68e67-c2b7-400a-8a8f-d714474634c7 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f4cde0d9-bb04-4e83-bc35-22f026ead5da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:39.558799 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8ce68e67-c2b7-400a-8a8f-d714474634c7 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:39.559657 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8ce68e67-c2b7-400a-8a8f-d714474634c7 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:39.562323 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8ce68e67-c2b7-400a-8a8f-d714474634c7 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:39.565719 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8ce68e67-c2b7-400a-8a8f-d714474634c7 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:40.370742 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-1d66cded-e5e4-4af8-a0ac-3a605a1b5030 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfeeed90aa346138d8c1d8c87a25572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d5cd11d3da467cafa26ca33bb4e830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:40.389270 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1d66cded-e5e4-4af8-a0ac-3a605a1b5030 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da" status: 200 len: 1315 microversion: 2.1 time: 0.958025 Feb 19 02:26:40.402906 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 23/55] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:39 2021] GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da => generated 1315 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:40.512359 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-0197f3a4-768f-4a2b-8e95-0f88d63eb634 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'create', calling method: .version_select at 0x7f217d6fc840>, body: {"keypair": {"name": "tempest-keypair-1361507524"}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:26:40.517765 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8ce68e67-c2b7-400a-8a8f-d714474634c7 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:40.530700 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8ce68e67-c2b7-400a-8a8f-d714474634c7 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da" status: 200 len: 1318 microversion: 2.1 time: 1.028144 Feb 19 02:26:40.531913 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 33/56] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:39 2021] GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da => generated 1318 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:40.554424 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ebea8302-578a-48a1-8405-a30294d977f6 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:40.555389 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ebea8302-578a-48a1-8405-a30294d977f6 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:40.569076 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ebea8302-578a-48a1-8405-a30294d977f6 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:40.570042 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ebea8302-578a-48a1-8405-a30294d977f6 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:40.571141 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ebea8302-578a-48a1-8405-a30294d977f6 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:40.571756 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ebea8302-578a-48a1-8405-a30294d977f6 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:40.630619 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-0197f3a4-768f-4a2b-8e95-0f88d63eb634 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Getting quotas for project ce3f0058e9cc413c9235ce9b044f5d1f. Resources: {'key_pairs'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:26:40.650598 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-0197f3a4-768f-4a2b-8e95-0f88d63eb634 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Getting quotas for user f95ba89e87bd4588a0c6c3593a6a4071 and project ce3f0058e9cc413c9235ce9b044f5d1f. Resources: {'key_pairs'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:26:41.531387 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-0197f3a4-768f-4a2b-8e95-0f88d63eb634 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Getting quotas for project ce3f0058e9cc413c9235ce9b044f5d1f. Resources: {'key_pairs'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:26:41.536670 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-0197f3a4-768f-4a2b-8e95-0f88d63eb634 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Getting quotas for user f95ba89e87bd4588a0c6c3593a6a4071 and project ce3f0058e9cc413c9235ce9b044f5d1f. Resources: {'key_pairs'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:26:41.555910 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-0197f3a4-768f-4a2b-8e95-0f88d63eb634 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.150615 Feb 19 02:26:41.556841 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 24/57] 10.222.0.44 () {60 vars in 1148 bytes} [Fri Feb 19 02:26:40 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:41.565351 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7670454a-9d05-4796-99de-420d1fdd386f tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:41.566048 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7670454a-9d05-4796-99de-420d1fdd386f tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:41.583355 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7670454a-9d05-4796-99de-420d1fdd386f tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:41.583911 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7670454a-9d05-4796-99de-420d1fdd386f tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:41.584907 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7670454a-9d05-4796-99de-420d1fdd386f tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:41.585410 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7670454a-9d05-4796-99de-420d1fdd386f tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:42.350422 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7670454a-9d05-4796-99de-420d1fdd386f tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfeeed90aa346138d8c1d8c87a25572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d5cd11d3da467cafa26ca33bb4e830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:42.363978 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7670454a-9d05-4796-99de-420d1fdd386f tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da" status: 200 len: 1315 microversion: 2.1 time: 0.805818 Feb 19 02:26:42.364598 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 25/58] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:41 2021] GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da => generated 1315 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:42.379463 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d40f4dcf-182f-4a58-b28e-048a59e56a22 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:42.384658 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d40f4dcf-182f-4a58-b28e-048a59e56a22 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f4cde0d9-bb04-4e83-bc35-22f026ead5da] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:42.401134 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d40f4dcf-182f-4a58-b28e-048a59e56a22 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:42.401645 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d40f4dcf-182f-4a58-b28e-048a59e56a22 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:42.403146 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d40f4dcf-182f-4a58-b28e-048a59e56a22 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:42.410656 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d40f4dcf-182f-4a58-b28e-048a59e56a22 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:42.423127 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ebea8302-578a-48a1-8405-a30294d977f6 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:42.437099 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ebea8302-578a-48a1-8405-a30294d977f6 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1321 microversion: 2.1 time: 1.887916 Feb 19 02:26:42.437942 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 34/59] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:40 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1321 bytes in 1895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:43.364760 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-d40f4dcf-182f-4a58-b28e-048a59e56a22 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:43.377785 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d40f4dcf-182f-4a58-b28e-048a59e56a22 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da" status: 200 len: 1318 microversion: 2.1 time: 1.007257 Feb 19 02:26:43.381202 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ca6084bc-4a2a-4598-a1a3-9acbff55822e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:43.382133 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ca6084bc-4a2a-4598-a1a3-9acbff55822e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:43.391253 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 26/60] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:42 2021] GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da => generated 1318 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:43.391741 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ca6084bc-4a2a-4598-a1a3-9acbff55822e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:43.392307 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ca6084bc-4a2a-4598-a1a3-9acbff55822e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:43.393354 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ca6084bc-4a2a-4598-a1a3-9acbff55822e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:43.393931 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ca6084bc-4a2a-4598-a1a3-9acbff55822e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:43.410016 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-5467203e-c211-4878-abaf-b28b0e4f7500 req-35faaf7d-1dd9-4657-b284-ca09cb5ef977 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0a55cfa-c2c0-48e5-b519-53c9b68c38cd", "tag": "0ea13f49-61f4-4ec3-9378-7226894dc825"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:26:43.412073 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:26:43.412073 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:26:43.422260 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-5467203e-c211-4878-abaf-b28b0e4f7500 req-35faaf7d-1dd9-4657-b284-ca09cb5ef977 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:43.422801 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-5467203e-c211-4878-abaf-b28b0e4f7500 req-35faaf7d-1dd9-4657-b284-ca09cb5ef977 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:43.444243 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-5467203e-c211-4878-abaf-b28b0e4f7500 req-35faaf7d-1dd9-4657-b284-ca09cb5ef977 service nova] Creating event network-changed:0ea13f49-61f4-4ec3-9378-7226894dc825 for instance c0a55cfa-c2c0-48e5-b519-53c9b68c38cd on hv-cinder-77642 Feb 19 02:26:43.464684 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-5467203e-c211-4878-abaf-b28b0e4f7500 req-35faaf7d-1dd9-4657-b284-ca09cb5ef977 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059828 Feb 19 02:26:43.465530 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 27/61] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:26:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:26:43.472859 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f5e20fb2-8f88-4d8a-9dc1-723c60b694e9 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:43.473628 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f5e20fb2-8f88-4d8a-9dc1-723c60b694e9 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:43.482166 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f5e20fb2-8f88-4d8a-9dc1-723c60b694e9 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:43.482905 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f5e20fb2-8f88-4d8a-9dc1-723c60b694e9 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:43.483754 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f5e20fb2-8f88-4d8a-9dc1-723c60b694e9 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:43.484238 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f5e20fb2-8f88-4d8a-9dc1-723c60b694e9 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:43.854157 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f5e20fb2-8f88-4d8a-9dc1-723c60b694e9 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:43.864596 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f5e20fb2-8f88-4d8a-9dc1-723c60b694e9 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1321 microversion: 2.1 time: 0.396593 Feb 19 02:26:43.865230 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 28/62] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:43 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1321 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:44.045432 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ca6084bc-4a2a-4598-a1a3-9acbff55822e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfeeed90aa346138d8c1d8c87a25572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d5cd11d3da467cafa26ca33bb4e830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:44.057208 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ca6084bc-4a2a-4598-a1a3-9acbff55822e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da" status: 200 len: 1315 microversion: 2.1 time: 0.679829 Feb 19 02:26:44.058054 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 35/63] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:43 2021] GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da => generated 1315 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:26:44.397201 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b4741bcb-6c60-49bf-9905-a04c3b57bf59 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:44.397855 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b4741bcb-6c60-49bf-9905-a04c3b57bf59 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f4cde0d9-bb04-4e83-bc35-22f026ead5da] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:44.410621 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b4741bcb-6c60-49bf-9905-a04c3b57bf59 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:44.411278 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b4741bcb-6c60-49bf-9905-a04c3b57bf59 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:44.412213 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b4741bcb-6c60-49bf-9905-a04c3b57bf59 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:44.413646 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b4741bcb-6c60-49bf-9905-a04c3b57bf59 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:44.667302 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b4741bcb-6c60-49bf-9905-a04c3b57bf59 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:44.678127 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b4741bcb-6c60-49bf-9905-a04c3b57bf59 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da" status: 200 len: 1318 microversion: 2.1 time: 0.284911 Feb 19 02:26:44.679148 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 29/64] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:44 2021] GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:44.772236 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c32cabdd-e255-46b7-9eb2-807b9a97cf15 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-204156923", "imageRef": "37a0f9d8-d3f7-417e-bce6-371e41a47c88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5b4ec2dc-41c0-4415-958d-7f5e107c8197"}], "security_groups": [{"name": "tempest-securitygroup--761651256"}], "key_name": "tempest-keypair-588318548", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:26:44.875812 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-171600d7-d32d-4d20-a5d8-5ebfbcc0b17a req-139fc5b7-1416-47e4-b7c1-b58c6218aeb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a95f9f7-96ac-4fc6-8ef3-95fb723b525a", "tag": "023b83ee-b321-4330-8efb-ac121d463f35"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:26:44.877641 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:26:44.877641 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:26:44.896714 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-171600d7-d32d-4d20-a5d8-5ebfbcc0b17a req-139fc5b7-1416-47e4-b7c1-b58c6218aeb7 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:44.897192 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-171600d7-d32d-4d20-a5d8-5ebfbcc0b17a req-139fc5b7-1416-47e4-b7c1-b58c6218aeb7 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:44.952971 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-171600d7-d32d-4d20-a5d8-5ebfbcc0b17a req-139fc5b7-1416-47e4-b7c1-b58c6218aeb7 service nova] Creating event network-changed:023b83ee-b321-4330-8efb-ac121d463f35 for instance 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a on hv-cinder-77642 Feb 19 02:26:44.962566 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-171600d7-d32d-4d20-a5d8-5ebfbcc0b17a req-139fc5b7-1416-47e4-b7c1-b58c6218aeb7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090302 Feb 19 02:26:44.963223 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 30/65] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:26:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:26:44.978573 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-adceb17a-c095-499e-bf38-024d3e29d456 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:44.980963 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-adceb17a-c095-499e-bf38-024d3e29d456 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:44.991565 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-adceb17a-c095-499e-bf38-024d3e29d456 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:44.994591 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-adceb17a-c095-499e-bf38-024d3e29d456 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:44.995742 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-adceb17a-c095-499e-bf38-024d3e29d456 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:44.996374 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-adceb17a-c095-499e-bf38-024d3e29d456 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:45.002243 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-c32cabdd-e255-46b7-9eb2-807b9a97cf15 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] validate_networks() for [('5b4ec2dc-41c0-4415-958d-7f5e107c8197', None, None, None)] {{(pid=98193) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 02:26:45.444949 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-adceb17a-c095-499e-bf38-024d3e29d456 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:45.455171 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-adceb17a-c095-499e-bf38-024d3e29d456 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1321 microversion: 2.1 time: 0.488847 Feb 19 02:26:45.455786 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 31/66] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:44 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1321 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:45.460798 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4ce7d3c8-df5f-4d82-ab84-7c17ee62e5a6 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:45.461450 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-4ce7d3c8-df5f-4d82-ab84-7c17ee62e5a6 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:45.470037 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4ce7d3c8-df5f-4d82-ab84-7c17ee62e5a6 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:45.470578 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4ce7d3c8-df5f-4d82-ab84-7c17ee62e5a6 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:45.471431 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4ce7d3c8-df5f-4d82-ab84-7c17ee62e5a6 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:45.471915 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4ce7d3c8-df5f-4d82-ab84-7c17ee62e5a6 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:45.689221 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-c32cabdd-e255-46b7-9eb2-807b9a97cf15 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Flavor limits 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 02:26:45.689784 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-c32cabdd-e255-46b7-9eb2-807b9a97cf15 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Image limits 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 02:26:45.691566 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-c32cabdd-e255-46b7-9eb2-807b9a97cf15 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Flavor pref 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 02:26:45.691566 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-c32cabdd-e255-46b7-9eb2-807b9a97cf15 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Image pref 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 02:26:45.691566 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-c32cabdd-e255-46b7-9eb2-807b9a97cf15 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 02:26:45.706060 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c32cabdd-e255-46b7-9eb2-807b9a97cf15 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:45.706538 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c32cabdd-e255-46b7-9eb2-807b9a97cf15 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:45.707857 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c32cabdd-e255-46b7-9eb2-807b9a97cf15 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:45.708668 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c32cabdd-e255-46b7-9eb2-807b9a97cf15 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:45.732593 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-c32cabdd-e255-46b7-9eb2-807b9a97cf15 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Getting quotas for project c5e1c746a8dc450eb96f1b22cd181e50. Resources: {'ram', 'instances', 'cores'} {{(pid=98193) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:26:45.739574 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-c32cabdd-e255-46b7-9eb2-807b9a97cf15 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Getting quotas for user 485c785ecc8b41ffa4a9b1e908cb5145 and project c5e1c746a8dc450eb96f1b22cd181e50. Resources: {'ram', 'instances', 'cores'} {{(pid=98193) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:26:45.757140 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c32cabdd-e255-46b7-9eb2-807b9a97cf15 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Going to run 1 instances... {{(pid=98193) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 02:26:45.759885 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c32cabdd-e255-46b7-9eb2-807b9a97cf15 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37a0f9d8-d3f7-417e-bce6-371e41a47c88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 02:26:45.823950 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c32cabdd-e255-46b7-9eb2-807b9a97cf15 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.060938 Feb 19 02:26:45.825145 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 36/67] 10.222.0.44 () {62 vars in 1178 bytes} [Fri Feb 19 02:26:44 2021] POST /compute/v2.1/servers => generated 401 bytes in 1064 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Feb 19 02:26:45.830813 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7f295761-c710-464b-9221-b01d70ef423e tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:45.832145 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7f295761-c710-464b-9221-b01d70ef423e tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f4cde0d9-bb04-4e83-bc35-22f026ead5da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:45.845813 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7f295761-c710-464b-9221-b01d70ef423e tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:45.846574 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7f295761-c710-464b-9221-b01d70ef423e tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:45.847596 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7f295761-c710-464b-9221-b01d70ef423e tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:45.848369 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7f295761-c710-464b-9221-b01d70ef423e tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:46.432667 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-4ce7d3c8-df5f-4d82-ab84-7c17ee62e5a6 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfeeed90aa346138d8c1d8c87a25572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d5cd11d3da467cafa26ca33bb4e830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:46.442546 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-4ce7d3c8-df5f-4d82-ab84-7c17ee62e5a6 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da" status: 200 len: 1315 microversion: 2.1 time: 0.985473 Feb 19 02:26:46.443508 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 32/68] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:45 2021] GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da => generated 1315 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:46.459750 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ae6ef65b-c162-4663-93d9-65c14ff499b1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:46.460994 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ae6ef65b-c162-4663-93d9-65c14ff499b1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:46.462672 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7f295761-c710-464b-9221-b01d70ef423e tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:46.472143 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7f295761-c710-464b-9221-b01d70ef423e tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da" status: 200 len: 1318 microversion: 2.1 time: 0.645699 Feb 19 02:26:46.474615 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 37/69] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:45 2021] GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da => generated 1318 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:46.479997 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e09b2c99-e58e-4e0b-aa41-bec95a6b6f35 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:46.480382 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ae6ef65b-c162-4663-93d9-65c14ff499b1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:46.481178 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ae6ef65b-c162-4663-93d9-65c14ff499b1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:46.482688 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ae6ef65b-c162-4663-93d9-65c14ff499b1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:46.483346 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ae6ef65b-c162-4663-93d9-65c14ff499b1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:46.487184 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e09b2c99-e58e-4e0b-aa41-bec95a6b6f35 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:46.497272 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e09b2c99-e58e-4e0b-aa41-bec95a6b6f35 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:46.499884 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e09b2c99-e58e-4e0b-aa41-bec95a6b6f35 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:46.501483 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e09b2c99-e58e-4e0b-aa41-bec95a6b6f35 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:46.502172 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e09b2c99-e58e-4e0b-aa41-bec95a6b6f35 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:47.044260 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e09b2c99-e58e-4e0b-aa41-bec95a6b6f35 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:47.057483 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e09b2c99-e58e-4e0b-aa41-bec95a6b6f35 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1321 microversion: 2.1 time: 0.581674 Feb 19 02:26:47.062045 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ae6ef65b-c162-4663-93d9-65c14ff499b1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:47.079718 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ae6ef65b-c162-4663-93d9-65c14ff499b1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:47.080399 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 38/70] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:46 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1321 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:47.082140 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ae6ef65b-c162-4663-93d9-65c14ff499b1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:47.083549 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ae6ef65b-c162-4663-93d9-65c14ff499b1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1284 microversion: 2.20 time: 0.628006 Feb 19 02:26:47.084346 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 33/71] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:26:46 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1284 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:26:47.462026 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1b4827f7-ba37-4aa0-ac9b-26c6670523f1 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:47.462739 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1b4827f7-ba37-4aa0-ac9b-26c6670523f1 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:47.490856 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-38f0c825-bd50-40a8-9fd0-497d5d2eb7da tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:47.491538 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-38f0c825-bd50-40a8-9fd0-497d5d2eb7da tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f4cde0d9-bb04-4e83-bc35-22f026ead5da] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:47.498690 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1b4827f7-ba37-4aa0-ac9b-26c6670523f1 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:47.504772 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-38f0c825-bd50-40a8-9fd0-497d5d2eb7da tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:47.505529 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1b4827f7-ba37-4aa0-ac9b-26c6670523f1 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:47.506632 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1b4827f7-ba37-4aa0-ac9b-26c6670523f1 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:47.509299 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1b4827f7-ba37-4aa0-ac9b-26c6670523f1 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:47.514852 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-38f0c825-bd50-40a8-9fd0-497d5d2eb7da tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:47.517013 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-38f0c825-bd50-40a8-9fd0-497d5d2eb7da tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:47.518611 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-38f0c825-bd50-40a8-9fd0-497d5d2eb7da tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:48.530269 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-1b4827f7-ba37-4aa0-ac9b-26c6670523f1 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfeeed90aa346138d8c1d8c87a25572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d5cd11d3da467cafa26ca33bb4e830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:48.539935 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1b4827f7-ba37-4aa0-ac9b-26c6670523f1 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da" status: 200 len: 1315 microversion: 2.1 time: 1.081801 Feb 19 02:26:48.540548 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 39/72] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:47 2021] GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da => generated 1315 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:48.546179 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-9b3e2ab7-d3d2-45cf-b1b2-2827b6ae0b0b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:48.548159 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-9b3e2ab7-d3d2-45cf-b1b2-2827b6ae0b0b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:48.559467 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9b3e2ab7-d3d2-45cf-b1b2-2827b6ae0b0b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:48.560303 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9b3e2ab7-d3d2-45cf-b1b2-2827b6ae0b0b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:48.562472 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9b3e2ab7-d3d2-45cf-b1b2-2827b6ae0b0b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:48.563204 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9b3e2ab7-d3d2-45cf-b1b2-2827b6ae0b0b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:48.646238 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-38f0c825-bd50-40a8-9fd0-497d5d2eb7da tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:48.657575 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-38f0c825-bd50-40a8-9fd0-497d5d2eb7da tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da" status: 200 len: 1318 microversion: 2.1 time: 1.170725 Feb 19 02:26:48.682624 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 34/73] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:47 2021] GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da => generated 1318 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:48.688062 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8ba60958-a68a-4cdc-a805-736818b2ee18 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:48.688889 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8ba60958-a68a-4cdc-a805-736818b2ee18 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:48.697284 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8ba60958-a68a-4cdc-a805-736818b2ee18 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:48.698006 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8ba60958-a68a-4cdc-a805-736818b2ee18 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:48.699167 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8ba60958-a68a-4cdc-a805-736818b2ee18 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:48.700101 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8ba60958-a68a-4cdc-a805-736818b2ee18 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:48.948541 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8ba60958-a68a-4cdc-a805-736818b2ee18 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:48.965729 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8ba60958-a68a-4cdc-a805-736818b2ee18 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:48.967393 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8ba60958-a68a-4cdc-a805-736818b2ee18 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:48.968592 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8ba60958-a68a-4cdc-a805-736818b2ee18 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1338 microversion: 2.20 time: 0.284511 Feb 19 02:26:48.969234 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 35/74] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:26:48 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1338 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:26:49.068874 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9b3e2ab7-d3d2-45cf-b1b2-2827b6ae0b0b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:49.078562 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-9b3e2ab7-d3d2-45cf-b1b2-2827b6ae0b0b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1321 microversion: 2.1 time: 0.536644 Feb 19 02:26:49.079378 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 40/75] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:48 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1321 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:49.559208 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-2c73a7ec-2166-4c83-aaa3-799446303357 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:49.559873 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-2c73a7ec-2166-4c83-aaa3-799446303357 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:49.576482 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2c73a7ec-2166-4c83-aaa3-799446303357 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:49.578860 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2c73a7ec-2166-4c83-aaa3-799446303357 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:49.581484 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2c73a7ec-2166-4c83-aaa3-799446303357 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:49.583317 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2c73a7ec-2166-4c83-aaa3-799446303357 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:49.709909 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-6a4cf81a-f3cf-4b73-9628-b28a59970258 req-111eb288-8a04-4c03-bd99-41741faa0338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4cde0d9-bb04-4e83-bc35-22f026ead5da", "name": "network-vif-plugged", "status": "completed", "tag": "bc9c2baf-39ce-43cd-95df-a8bcd7ed3497"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:26:49.712624 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:26:49.712624 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:26:49.724553 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-6a4cf81a-f3cf-4b73-9628-b28a59970258 req-111eb288-8a04-4c03-bd99-41741faa0338 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:49.725390 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-6a4cf81a-f3cf-4b73-9628-b28a59970258 req-111eb288-8a04-4c03-bd99-41741faa0338 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:49.747299 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-6a4cf81a-f3cf-4b73-9628-b28a59970258 req-111eb288-8a04-4c03-bd99-41741faa0338 service nova] Creating event network-vif-plugged:bc9c2baf-39ce-43cd-95df-a8bcd7ed3497 for instance f4cde0d9-bb04-4e83-bc35-22f026ead5da on hv-cinder-77642 Feb 19 02:26:49.748450 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-6a4cf81a-f3cf-4b73-9628-b28a59970258 req-111eb288-8a04-4c03-bd99-41741faa0338 service nova] Acquired lock "compute-rpcapi-router" {{(pid=98193) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 19 02:26:49.750894 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8a898569-4278-466c-b23d-1b77494d0b44 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:49.751435 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8a898569-4278-466c-b23d-1b77494d0b44 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:49.752559 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8a898569-4278-466c-b23d-1b77494d0b44 None None] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:49.753242 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8a898569-4278-466c-b23d-1b77494d0b44 None None] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:49.764742 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.compute.rpcapi [None req-8a898569-4278-466c-b23d-1b77494d0b44 None None] Automatically selected compute RPC version 5.13 from minimum service version 54 Feb 19 02:26:49.766254 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8a898569-4278-466c-b23d-1b77494d0b44 None None] Releasing lock "compute-rpcapi-router" {{(pid=98193) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 19 02:26:49.800085 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8a898569-4278-466c-b23d-1b77494d0b44 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199265 Feb 19 02:26:49.801302 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 41/76] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:26:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:26:49.819238 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a3aef7a4-426e-4ac9-8dff-d181dce88ac6 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:49.819948 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a3aef7a4-426e-4ac9-8dff-d181dce88ac6 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f4cde0d9-bb04-4e83-bc35-22f026ead5da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:49.828876 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a3aef7a4-426e-4ac9-8dff-d181dce88ac6 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:49.829385 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a3aef7a4-426e-4ac9-8dff-d181dce88ac6 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:49.830258 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a3aef7a4-426e-4ac9-8dff-d181dce88ac6 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:49.831029 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a3aef7a4-426e-4ac9-8dff-d181dce88ac6 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:50.329941 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-2c73a7ec-2166-4c83-aaa3-799446303357 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfeeed90aa346138d8c1d8c87a25572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d5cd11d3da467cafa26ca33bb4e830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:50.346438 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-2c73a7ec-2166-4c83-aaa3-799446303357 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da" status: 200 len: 1315 microversion: 2.1 time: 0.791528 Feb 19 02:26:50.359439 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 36/77] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:49 2021] GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da => generated 1315 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:50.367118 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a3aef7a4-426e-4ac9-8dff-d181dce88ac6 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:50.383769 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a3aef7a4-426e-4ac9-8dff-d181dce88ac6 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da" status: 200 len: 1318 microversion: 2.1 time: 0.572964 Feb 19 02:26:50.385340 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b719a9d8-491a-4c6b-931a-7c17961995b2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:50.387170 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 42/78] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:49 2021] GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da => generated 1318 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:50.390757 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b719a9d8-491a-4c6b-931a-7c17961995b2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:50.401615 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-210302a7-6045-4ae6-9216-9b1e4e01d785 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:50.403076 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-210302a7-6045-4ae6-9216-9b1e4e01d785 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:50.410143 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b719a9d8-491a-4c6b-931a-7c17961995b2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:50.411315 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b719a9d8-491a-4c6b-931a-7c17961995b2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:50.418238 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b719a9d8-491a-4c6b-931a-7c17961995b2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:50.419120 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b719a9d8-491a-4c6b-931a-7c17961995b2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:50.419229 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-210302a7-6045-4ae6-9216-9b1e4e01d785 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:50.419668 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-210302a7-6045-4ae6-9216-9b1e4e01d785 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:50.420616 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-210302a7-6045-4ae6-9216-9b1e4e01d785 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:50.421537 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-210302a7-6045-4ae6-9216-9b1e4e01d785 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:50.894708 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b719a9d8-491a-4c6b-931a-7c17961995b2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:50.913400 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b719a9d8-491a-4c6b-931a-7c17961995b2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:50.914732 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-210302a7-6045-4ae6-9216-9b1e4e01d785 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:50.916458 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b719a9d8-491a-4c6b-931a-7c17961995b2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:50.918448 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b719a9d8-491a-4c6b-931a-7c17961995b2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1405 microversion: 2.20 time: 0.543707 Feb 19 02:26:50.920173 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 37/79] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:26:50 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1405 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:26:50.927623 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-00ff8b5d-8c0a-48c8-8f20-4b2e92ca03db tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-448153946", "imageRef": "37a0f9d8-d3f7-417e-bce6-371e41a47c88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fcb9e503-6dc6-4ac0-9d1f-9b46f2bce723"}], "security_groups": [{"name": "tempest-securitygroup--798910706"}], "key_name": "tempest-keypair-1361507524", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:26:50.929408 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-210302a7-6045-4ae6-9216-9b1e4e01d785 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1321 microversion: 2.1 time: 0.540339 Feb 19 02:26:50.930029 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 43/80] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:50 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1321 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:51.077603 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-00ff8b5d-8c0a-48c8-8f20-4b2e92ca03db tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] validate_networks() for [('fcb9e503-6dc6-4ac0-9d1f-9b46f2bce723', None, None, None)] {{(pid=98194) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 02:26:51.365409 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-17d57b2b-1306-4aff-9e71-55ed6db103af tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:51.366203 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-17d57b2b-1306-4aff-9e71-55ed6db103af tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:51.375738 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-17d57b2b-1306-4aff-9e71-55ed6db103af tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:51.376797 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-17d57b2b-1306-4aff-9e71-55ed6db103af tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:51.377881 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-17d57b2b-1306-4aff-9e71-55ed6db103af tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:51.379405 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-17d57b2b-1306-4aff-9e71-55ed6db103af tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:51.896743 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-17d57b2b-1306-4aff-9e71-55ed6db103af tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfeeed90aa346138d8c1d8c87a25572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d5cd11d3da467cafa26ca33bb4e830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:51.906386 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-17d57b2b-1306-4aff-9e71-55ed6db103af tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da" status: 200 len: 1315 microversion: 2.1 time: 0.544882 Feb 19 02:26:51.907385 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 44/81] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:51 2021] GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da => generated 1315 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:26:51.922007 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-66cbe00d-1064-4940-8f0f-7b1c5c03c41c tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:51.923010 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-66cbe00d-1064-4940-8f0f-7b1c5c03c41c tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f4cde0d9-bb04-4e83-bc35-22f026ead5da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:51.945698 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-66cbe00d-1064-4940-8f0f-7b1c5c03c41c tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:51.946721 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-66cbe00d-1064-4940-8f0f-7b1c5c03c41c tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:51.948147 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-66cbe00d-1064-4940-8f0f-7b1c5c03c41c tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:51.948823 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-66cbe00d-1064-4940-8f0f-7b1c5c03c41c tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:52.398004 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-00ff8b5d-8c0a-48c8-8f20-4b2e92ca03db tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Flavor limits 0:0:0 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 02:26:52.398560 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-00ff8b5d-8c0a-48c8-8f20-4b2e92ca03db tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Image limits 0:0:0 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 02:26:52.399393 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-00ff8b5d-8c0a-48c8-8f20-4b2e92ca03db tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Flavor pref 0:0:0 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 02:26:52.399856 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-00ff8b5d-8c0a-48c8-8f20-4b2e92ca03db tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Image pref 0:0:0 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 02:26:52.400322 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-00ff8b5d-8c0a-48c8-8f20-4b2e92ca03db tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 02:26:52.410344 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-00ff8b5d-8c0a-48c8-8f20-4b2e92ca03db tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:52.411247 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-00ff8b5d-8c0a-48c8-8f20-4b2e92ca03db tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:52.412834 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-00ff8b5d-8c0a-48c8-8f20-4b2e92ca03db tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:52.413543 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-00ff8b5d-8c0a-48c8-8f20-4b2e92ca03db tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:52.435595 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-00ff8b5d-8c0a-48c8-8f20-4b2e92ca03db tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Getting quotas for project ce3f0058e9cc413c9235ce9b044f5d1f. Resources: {'ram', 'instances', 'cores'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:26:52.441360 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-00ff8b5d-8c0a-48c8-8f20-4b2e92ca03db tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Getting quotas for user f95ba89e87bd4588a0c6c3593a6a4071 and project ce3f0058e9cc413c9235ce9b044f5d1f. Resources: {'ram', 'instances', 'cores'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:26:52.455551 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-00ff8b5d-8c0a-48c8-8f20-4b2e92ca03db tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Going to run 1 instances... {{(pid=98194) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 02:26:52.458475 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-00ff8b5d-8c0a-48c8-8f20-4b2e92ca03db tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37a0f9d8-d3f7-417e-bce6-371e41a47c88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 02:26:52.527055 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-00ff8b5d-8c0a-48c8-8f20-4b2e92ca03db tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.604441 Feb 19 02:26:52.528015 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 38/82] 10.222.0.44 () {60 vars in 1137 bytes} [Fri Feb 19 02:26:50 2021] POST /compute/v2.1/servers => generated 401 bytes in 1607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 02:26:52.533448 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-dbd76899-e8c6-418d-9935-b1ee92b7a46e req-62570faf-8912-443f-b79b-f931c1ce0273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e5b207a-9887-4414-9e31-577bab1ff7da", "name": "network-vif-plugged", "status": "completed", "tag": "539d7478-42da-4489-996c-fb72328e93ff"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:26:52.536634 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:26:52.536634 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:26:52.551725 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-dbd76899-e8c6-418d-9935-b1ee92b7a46e req-62570faf-8912-443f-b79b-f931c1ce0273 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:52.554559 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-dbd76899-e8c6-418d-9935-b1ee92b7a46e req-62570faf-8912-443f-b79b-f931c1ce0273 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:52.580545 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-dbd76899-e8c6-418d-9935-b1ee92b7a46e req-62570faf-8912-443f-b79b-f931c1ce0273 service nova] Creating event network-vif-plugged:539d7478-42da-4489-996c-fb72328e93ff for instance 7e5b207a-9887-4414-9e31-577bab1ff7da on hv-cinder-77642 Feb 19 02:26:52.587129 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-dbd76899-e8c6-418d-9935-b1ee92b7a46e req-62570faf-8912-443f-b79b-f931c1ce0273 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057359 Feb 19 02:26:52.588170 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 39/83] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:26:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:26:52.596364 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-cccc6ef9-03a3-4d93-80de-3e9e19c9b026 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:52.597460 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-cccc6ef9-03a3-4d93-80de-3e9e19c9b026 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:52.608953 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cccc6ef9-03a3-4d93-80de-3e9e19c9b026 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:52.610543 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cccc6ef9-03a3-4d93-80de-3e9e19c9b026 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:52.611712 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cccc6ef9-03a3-4d93-80de-3e9e19c9b026 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:52.612315 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cccc6ef9-03a3-4d93-80de-3e9e19c9b026 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:52.635945 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-66cbe00d-1064-4940-8f0f-7b1c5c03c41c tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:52.664320 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-66cbe00d-1064-4940-8f0f-7b1c5c03c41c tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da" status: 200 len: 1318 microversion: 2.1 time: 0.755419 Feb 19 02:26:52.664844 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 45/84] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:51 2021] GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da => generated 1318 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:52.682468 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-14624c13-e260-4191-bf68-cdc3f9daab64 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:52.683147 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-14624c13-e260-4191-bf68-cdc3f9daab64 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:52.716592 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-14624c13-e260-4191-bf68-cdc3f9daab64 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:52.717334 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-14624c13-e260-4191-bf68-cdc3f9daab64 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:52.718454 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-14624c13-e260-4191-bf68-cdc3f9daab64 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:52.719148 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-14624c13-e260-4191-bf68-cdc3f9daab64 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:53.126528 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-cccc6ef9-03a3-4d93-80de-3e9e19c9b026 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:53.145806 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-cccc6ef9-03a3-4d93-80de-3e9e19c9b026 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:53.147862 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-cccc6ef9-03a3-4d93-80de-3e9e19c9b026 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:53.152977 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-cccc6ef9-03a3-4d93-80de-3e9e19c9b026 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1405 microversion: 2.20 time: 0.563422 Feb 19 02:26:53.155539 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 40/85] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:26:52 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1405 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:26:53.172258 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-638f60c0-99d7-4a9d-a53e-0934cb644698 req-c8cededf-2ba5-4896-a531-d18d1178069e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5265f377-f5b9-4f2c-a6e8-3bf64fb08733", "tag": "f7dc3053-2f41-4450-982f-60c5d1f56ee3"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:26:53.174507 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:26:53.174507 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:26:53.185767 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-638f60c0-99d7-4a9d-a53e-0934cb644698 req-c8cededf-2ba5-4896-a531-d18d1178069e service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:53.186499 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-638f60c0-99d7-4a9d-a53e-0934cb644698 req-c8cededf-2ba5-4896-a531-d18d1178069e service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:53.209295 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-638f60c0-99d7-4a9d-a53e-0934cb644698 req-c8cededf-2ba5-4896-a531-d18d1178069e service nova] Creating event network-changed:f7dc3053-2f41-4450-982f-60c5d1f56ee3 for instance 5265f377-f5b9-4f2c-a6e8-3bf64fb08733 on hv-cinder-77642 Feb 19 02:26:53.215972 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-638f60c0-99d7-4a9d-a53e-0934cb644698 req-c8cededf-2ba5-4896-a531-d18d1178069e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058935 Feb 19 02:26:53.217289 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 41/86] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:26:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:26:53.223853 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c9dfb042-712e-4647-b284-f9e80aa04153 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:53.225028 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c9dfb042-712e-4647-b284-f9e80aa04153 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:53.300962 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-14624c13-e260-4191-bf68-cdc3f9daab64 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:53.313926 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-14624c13-e260-4191-bf68-cdc3f9daab64 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1321 microversion: 2.1 time: 0.635389 Feb 19 02:26:53.318905 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 46/87] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:52 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1321 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:53.325416 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-2bc7abb1-b81b-494b-993a-033e8bd6c036 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:53.326259 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-2bc7abb1-b81b-494b-993a-033e8bd6c036 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:53.335422 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2bc7abb1-b81b-494b-993a-033e8bd6c036 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:53.336196 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2bc7abb1-b81b-494b-993a-033e8bd6c036 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:53.337322 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2bc7abb1-b81b-494b-993a-033e8bd6c036 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:53.338117 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2bc7abb1-b81b-494b-993a-033e8bd6c036 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:53.384441 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c9dfb042-712e-4647-b284-f9e80aa04153 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:53.400928 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c9dfb042-712e-4647-b284-f9e80aa04153 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1237 microversion: 2.1 time: 0.182105 Feb 19 02:26:53.401601 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 42/88] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:53 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1237 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:53.682752 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5ca824b8-ab80-43ba-aed3-2b24e0cceabc tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:53.684138 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5ca824b8-ab80-43ba-aed3-2b24e0cceabc tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f4cde0d9-bb04-4e83-bc35-22f026ead5da] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:53.703517 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5ca824b8-ab80-43ba-aed3-2b24e0cceabc tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:53.704193 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5ca824b8-ab80-43ba-aed3-2b24e0cceabc tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:53.705048 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5ca824b8-ab80-43ba-aed3-2b24e0cceabc tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:53.705535 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5ca824b8-ab80-43ba-aed3-2b24e0cceabc tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:53.872501 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-2bc7abb1-b81b-494b-993a-033e8bd6c036 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfeeed90aa346138d8c1d8c87a25572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d5cd11d3da467cafa26ca33bb4e830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:53.883071 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-2bc7abb1-b81b-494b-993a-033e8bd6c036 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da" status: 200 len: 1315 microversion: 2.1 time: 0.562696 Feb 19 02:26:53.887783 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 47/89] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:53 2021] GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da => generated 1315 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:54.151851 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5ca824b8-ab80-43ba-aed3-2b24e0cceabc tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:54.162872 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5ca824b8-ab80-43ba-aed3-2b24e0cceabc tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da" status: 200 len: 1318 microversion: 2.1 time: 0.484481 Feb 19 02:26:54.163797 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 43/90] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:53 2021] GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da => generated 1318 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:54.179456 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8d6ce1b9-3266-4a1f-995c-cc4f63056a18 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:54.180301 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8d6ce1b9-3266-4a1f-995c-cc4f63056a18 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:54.194185 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8d6ce1b9-3266-4a1f-995c-cc4f63056a18 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:54.196803 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8d6ce1b9-3266-4a1f-995c-cc4f63056a18 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:54.197803 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8d6ce1b9-3266-4a1f-995c-cc4f63056a18 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:54.200699 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8d6ce1b9-3266-4a1f-995c-cc4f63056a18 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:54.343566 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7208794c-bad8-4ad5-a6be-63f8bddb3f3b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:54.344857 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7208794c-bad8-4ad5-a6be-63f8bddb3f3b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:54.402457 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7208794c-bad8-4ad5-a6be-63f8bddb3f3b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:54.403126 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7208794c-bad8-4ad5-a6be-63f8bddb3f3b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:54.405958 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7208794c-bad8-4ad5-a6be-63f8bddb3f3b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:54.406514 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7208794c-bad8-4ad5-a6be-63f8bddb3f3b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:55.080868 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8d6ce1b9-3266-4a1f-995c-cc4f63056a18 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:55.094266 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8d6ce1b9-3266-4a1f-995c-cc4f63056a18 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:55.100686 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8d6ce1b9-3266-4a1f-995c-cc4f63056a18 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:55.102206 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8d6ce1b9-3266-4a1f-995c-cc4f63056a18 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1405 microversion: 2.20 time: 0.931619 Feb 19 02:26:55.104651 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 48/91] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:26:54 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1405 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:26:55.119783 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-9e4ed6f1-4682-4c12-b54a-fdb0f13324b3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:55.122042 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-9e4ed6f1-4682-4c12-b54a-fdb0f13324b3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:55.147440 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9e4ed6f1-4682-4c12-b54a-fdb0f13324b3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:55.148014 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9e4ed6f1-4682-4c12-b54a-fdb0f13324b3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:55.149056 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9e4ed6f1-4682-4c12-b54a-fdb0f13324b3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:55.149573 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9e4ed6f1-4682-4c12-b54a-fdb0f13324b3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:55.263560 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7208794c-bad8-4ad5-a6be-63f8bddb3f3b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:55.279724 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7208794c-bad8-4ad5-a6be-63f8bddb3f3b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1321 microversion: 2.1 time: 0.940544 Feb 19 02:26:55.282444 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 44/92] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:54 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1321 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:55.293053 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-c6103179-6d25-49e6-8b8b-f50defafa606 req-dbd0c97e-caec-420b-8251-9071a34ee529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a95f9f7-96ac-4fc6-8ef3-95fb723b525a", "name": "network-vif-plugged", "status": "completed", "tag": "023b83ee-b321-4330-8efb-ac121d463f35"}, {"server_uuid": "c0a55cfa-c2c0-48e5-b519-53c9b68c38cd", "name": "network-vif-plugged", "status": "completed", "tag": "0ea13f49-61f4-4ec3-9378-7226894dc825"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:26:55.299655 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:26:55.299655 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:26:55.320158 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-c6103179-6d25-49e6-8b8b-f50defafa606 req-dbd0c97e-caec-420b-8251-9071a34ee529 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:55.320656 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-c6103179-6d25-49e6-8b8b-f50defafa606 req-dbd0c97e-caec-420b-8251-9071a34ee529 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:55.347312 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-c6103179-6d25-49e6-8b8b-f50defafa606 req-dbd0c97e-caec-420b-8251-9071a34ee529 service nova] Creating event network-vif-plugged:023b83ee-b321-4330-8efb-ac121d463f35 for instance 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a on hv-cinder-77642 Feb 19 02:26:55.348336 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-c6103179-6d25-49e6-8b8b-f50defafa606 req-dbd0c97e-caec-420b-8251-9071a34ee529 service nova] Creating event network-vif-plugged:0ea13f49-61f4-4ec3-9378-7226894dc825 for instance c0a55cfa-c2c0-48e5-b519-53c9b68c38cd on hv-cinder-77642 Feb 19 02:26:55.355946 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-c6103179-6d25-49e6-8b8b-f50defafa606 req-dbd0c97e-caec-420b-8251-9071a34ee529 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.071876 Feb 19 02:26:55.357476 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 45/93] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:26:55 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:26:55.364634 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-88a3ca39-9653-4e2c-a451-8f6e9b052880 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:55.365397 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-88a3ca39-9653-4e2c-a451-8f6e9b052880 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:55.392188 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-88a3ca39-9653-4e2c-a451-8f6e9b052880 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:55.393630 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-88a3ca39-9653-4e2c-a451-8f6e9b052880 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:55.394551 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-88a3ca39-9653-4e2c-a451-8f6e9b052880 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:55.395073 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-88a3ca39-9653-4e2c-a451-8f6e9b052880 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:55.409714 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9e4ed6f1-4682-4c12-b54a-fdb0f13324b3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:55.420515 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-9e4ed6f1-4682-4c12-b54a-fdb0f13324b3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1295 microversion: 2.1 time: 0.314371 Feb 19 02:26:55.421357 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 49/94] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:55 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1295 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:55.438046 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-94d7b5da-d785-47a8-9ac2-3c118c82c85b tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:55.438747 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-94d7b5da-d785-47a8-9ac2-3c118c82c85b tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f4cde0d9-bb04-4e83-bc35-22f026ead5da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:55.469307 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-94d7b5da-d785-47a8-9ac2-3c118c82c85b tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:55.469662 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-94d7b5da-d785-47a8-9ac2-3c118c82c85b tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:55.470463 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-94d7b5da-d785-47a8-9ac2-3c118c82c85b tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:55.484126 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-94d7b5da-d785-47a8-9ac2-3c118c82c85b tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:56.282280 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-94d7b5da-d785-47a8-9ac2-3c118c82c85b tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:56.296594 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-94d7b5da-d785-47a8-9ac2-3c118c82c85b tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da" status: 200 len: 1505 microversion: 2.1 time: 0.874261 Feb 19 02:26:56.297537 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 50/95] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:55 2021] GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da => generated 1505 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:56.309292 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-229b4486-be8f-4a93-aa9a-e94bb0e2118f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:56.310501 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-229b4486-be8f-4a93-aa9a-e94bb0e2118f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:56.331472 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-88a3ca39-9653-4e2c-a451-8f6e9b052880 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfeeed90aa346138d8c1d8c87a25572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d5cd11d3da467cafa26ca33bb4e830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:56.364026 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-229b4486-be8f-4a93-aa9a-e94bb0e2118f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:56.365020 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-229b4486-be8f-4a93-aa9a-e94bb0e2118f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:56.366073 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-229b4486-be8f-4a93-aa9a-e94bb0e2118f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:56.366784 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-229b4486-be8f-4a93-aa9a-e94bb0e2118f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:56.366891 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-88a3ca39-9653-4e2c-a451-8f6e9b052880 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da" status: 200 len: 1502 microversion: 2.1 time: 0.992223 Feb 19 02:26:56.367550 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 46/96] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:55 2021] GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da => generated 1502 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:56.379369 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-15f50ba5-8e37-4d8a-805d-f0daf66fd986 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:56.380118 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-15f50ba5-8e37-4d8a-805d-f0daf66fd986 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:56.408505 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-15f50ba5-8e37-4d8a-805d-f0daf66fd986 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:56.416401 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-15f50ba5-8e37-4d8a-805d-f0daf66fd986 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:56.417488 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-15f50ba5-8e37-4d8a-805d-f0daf66fd986 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:56.417996 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-15f50ba5-8e37-4d8a-805d-f0daf66fd986 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:56.734837 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-229b4486-be8f-4a93-aa9a-e94bb0e2118f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:56.745211 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-229b4486-be8f-4a93-aa9a-e94bb0e2118f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:56.753004 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-229b4486-be8f-4a93-aa9a-e94bb0e2118f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:56.754213 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-229b4486-be8f-4a93-aa9a-e94bb0e2118f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1405 microversion: 2.20 time: 0.455472 Feb 19 02:26:56.766466 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 51/97] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:26:56 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1405 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:26:56.768178 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-0d0213b7-3fec-4bbf-9378-9094c0a6928a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:56.768848 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-0d0213b7-3fec-4bbf-9378-9094c0a6928a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:56.792330 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0d0213b7-3fec-4bbf-9378-9094c0a6928a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:56.792922 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0d0213b7-3fec-4bbf-9378-9094c0a6928a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:56.796528 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0d0213b7-3fec-4bbf-9378-9094c0a6928a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:56.797039 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0d0213b7-3fec-4bbf-9378-9094c0a6928a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:57.074310 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-0d0213b7-3fec-4bbf-9378-9094c0a6928a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:57.085526 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-0d0213b7-3fec-4bbf-9378-9094c0a6928a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1295 microversion: 2.1 time: 0.329372 Feb 19 02:26:57.097490 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 52/98] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:56 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1295 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:57.149752 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-15f50ba5-8e37-4d8a-805d-f0daf66fd986 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:57.171903 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-15f50ba5-8e37-4d8a-805d-f0daf66fd986 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1321 microversion: 2.1 time: 0.803082 Feb 19 02:26:57.173361 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 47/99] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:56 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1321 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:57.779572 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-09a4d093-a37a-488e-8210-2a7e7dd14a72 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:57.780054 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-09a4d093-a37a-488e-8210-2a7e7dd14a72 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:57.802411 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-09a4d093-a37a-488e-8210-2a7e7dd14a72 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:57.811179 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-09a4d093-a37a-488e-8210-2a7e7dd14a72 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:57.812344 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-09a4d093-a37a-488e-8210-2a7e7dd14a72 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:57.812993 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-09a4d093-a37a-488e-8210-2a7e7dd14a72 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:57.979554 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-6933f9ae-4915-4269-b6d1-3604f468e8dd req-5c1fb4f6-c05b-4b24-b650-4514dc77f3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5265f377-f5b9-4f2c-a6e8-3bf64fb08733", "name": "network-vif-plugged", "status": "completed", "tag": "f7dc3053-2f41-4450-982f-60c5d1f56ee3"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:26:57.982850 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:26:57.982850 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:26:58.018823 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-6933f9ae-4915-4269-b6d1-3604f468e8dd req-5c1fb4f6-c05b-4b24-b650-4514dc77f3b6 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:58.021441 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-6933f9ae-4915-4269-b6d1-3604f468e8dd req-5c1fb4f6-c05b-4b24-b650-4514dc77f3b6 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:58.075671 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-6933f9ae-4915-4269-b6d1-3604f468e8dd req-5c1fb4f6-c05b-4b24-b650-4514dc77f3b6 service nova] Creating event network-vif-plugged:f7dc3053-2f41-4450-982f-60c5d1f56ee3 for instance 5265f377-f5b9-4f2c-a6e8-3bf64fb08733 on hv-cinder-77642 Feb 19 02:26:58.083470 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-6933f9ae-4915-4269-b6d1-3604f468e8dd req-5c1fb4f6-c05b-4b24-b650-4514dc77f3b6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107659 Feb 19 02:26:58.088706 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 48/100] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:26:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:26:58.106295 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-134e1857-69af-44b8-a369-b8aa868dc4ad tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:58.107340 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-134e1857-69af-44b8-a369-b8aa868dc4ad tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:58.128230 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-134e1857-69af-44b8-a369-b8aa868dc4ad tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:58.132884 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-134e1857-69af-44b8-a369-b8aa868dc4ad tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:58.134192 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-134e1857-69af-44b8-a369-b8aa868dc4ad tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:58.136740 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-134e1857-69af-44b8-a369-b8aa868dc4ad tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:58.847207 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-09a4d093-a37a-488e-8210-2a7e7dd14a72 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:58.859966 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-09a4d093-a37a-488e-8210-2a7e7dd14a72 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:58.864358 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-09a4d093-a37a-488e-8210-2a7e7dd14a72 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:58.869228 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-09a4d093-a37a-488e-8210-2a7e7dd14a72 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1405 microversion: 2.20 time: 1.094433 Feb 19 02:26:58.871221 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 53/101] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:26:57 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1405 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:26:58.884771 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ae95d5cb-72da-450a-8cd2-0e048bb69798 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:26:58.885578 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ae95d5cb-72da-450a-8cd2-0e048bb69798 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:58.904903 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ae95d5cb-72da-450a-8cd2-0e048bb69798 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:58.905428 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ae95d5cb-72da-450a-8cd2-0e048bb69798 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:58.906533 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ae95d5cb-72da-450a-8cd2-0e048bb69798 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:58.907214 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ae95d5cb-72da-450a-8cd2-0e048bb69798 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:59.395835 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ae95d5cb-72da-450a-8cd2-0e048bb69798 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:26:59.411219 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ae95d5cb-72da-450a-8cd2-0e048bb69798 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1515 microversion: 2.1 time: 0.537537 Feb 19 02:26:59.412637 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 54/102] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:58 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1515 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:26:59.418986 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-2dd43879-835b-426b-a19d-c3559e856e96 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68d881b9-67c9-49b5-a4d0-dfbb488cf711"}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:26:59.421730 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-2dd43879-835b-426b-a19d-c3559e856e96 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f4cde0d9-bb04-4e83-bc35-22f026ead5da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:26:59.435985 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2dd43879-835b-426b-a19d-c3559e856e96 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:59.436807 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2dd43879-835b-426b-a19d-c3559e856e96 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:59.438574 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2dd43879-835b-426b-a19d-c3559e856e96 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:26:59.439367 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2dd43879-835b-426b-a19d-c3559e856e96 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:26:59.987354 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-2dd43879-835b-426b-a19d-c3559e856e96 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "POST /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.572725 Feb 19 02:26:59.988575 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 55/103] 10.222.0.44 () {60 vars in 1313 bytes} [Fri Feb 19 02:26:59 2021] POST /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da/os-volume_attachments => generated 194 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:27:00.002345 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8f8f046b-5cb0-43a6-9108-5172f26b3f8e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c5dd15e-3b4a-4830-9af9-ac20c34a726a"}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:00.003851 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8f8f046b-5cb0-43a6-9108-5172f26b3f8e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:00.013908 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8f8f046b-5cb0-43a6-9108-5172f26b3f8e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:00.015127 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8f8f046b-5cb0-43a6-9108-5172f26b3f8e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:00.016157 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8f8f046b-5cb0-43a6-9108-5172f26b3f8e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:00.017545 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8f8f046b-5cb0-43a6-9108-5172f26b3f8e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:00.116329 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-134e1857-69af-44b8-a369-b8aa868dc4ad tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:00.132815 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-134e1857-69af-44b8-a369-b8aa868dc4ad tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1362 microversion: 2.1 time: 2.027287 Feb 19 02:27:00.133829 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 49/104] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:26:58 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1362 bytes in 2035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:27:00.139937 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-34a09db8-d3fe-492e-b2c8-3ddd4d3cee6d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:00.145708 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-34a09db8-d3fe-492e-b2c8-3ddd4d3cee6d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:00.166255 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-34a09db8-d3fe-492e-b2c8-3ddd4d3cee6d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:00.168592 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-34a09db8-d3fe-492e-b2c8-3ddd4d3cee6d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:00.172699 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-34a09db8-d3fe-492e-b2c8-3ddd4d3cee6d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:00.173965 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-34a09db8-d3fe-492e-b2c8-3ddd4d3cee6d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:00.252899 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.objects.instance [None req-34a09db8-d3fe-492e-b2c8-3ddd4d3cee6d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lazy-loading 'flavor' on Instance uuid 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a {{(pid=98194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 02:27:00.629710 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-34a09db8-d3fe-492e-b2c8-3ddd4d3cee6d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "POST /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a/action" status: 200 len: 32 microversion: 2.1 time: 0.493995 Feb 19 02:27:00.643173 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 50/105] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:27:00 2021] POST /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a/action => generated 32 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:27:00.664231 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-3d6c424e-2f17-42ed-9145-a49cda4d7ab0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:00.665422 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-3d6c424e-2f17-42ed-9145-a49cda4d7ab0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:00.683753 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3d6c424e-2f17-42ed-9145-a49cda4d7ab0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:00.687464 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3d6c424e-2f17-42ed-9145-a49cda4d7ab0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:00.689418 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3d6c424e-2f17-42ed-9145-a49cda4d7ab0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:00.690731 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3d6c424e-2f17-42ed-9145-a49cda4d7ab0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:00.929115 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8f8f046b-5cb0-43a6-9108-5172f26b3f8e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "POST /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.932826 Feb 19 02:27:00.930585 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 56/106] 10.222.0.44 () {60 vars in 1313 bytes} [Fri Feb 19 02:26:59 2021] POST /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da/os-volume_attachments => generated 194 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:27:00.937840 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-6049b853-3a57-4b0e-98f2-d15410887a61 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:00.938846 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-6049b853-3a57-4b0e-98f2-d15410887a61 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:00.950774 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6049b853-3a57-4b0e-98f2-d15410887a61 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:00.951522 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6049b853-3a57-4b0e-98f2-d15410887a61 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:00.952517 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6049b853-3a57-4b0e-98f2-d15410887a61 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:00.953659 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6049b853-3a57-4b0e-98f2-d15410887a61 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:01.340023 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-6049b853-3a57-4b0e-98f2-d15410887a61 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:01.356267 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-6049b853-3a57-4b0e-98f2-d15410887a61 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1521 microversion: 2.1 time: 0.424172 Feb 19 02:27:01.358638 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 57/107] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:00 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1521 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:01.368570 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c33201f7-236f-4ffc-b132-5c318be2273a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:01.369582 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c33201f7-236f-4ffc-b132-5c318be2273a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:01.385431 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c33201f7-236f-4ffc-b132-5c318be2273a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:01.386572 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c33201f7-236f-4ffc-b132-5c318be2273a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:01.391118 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c33201f7-236f-4ffc-b132-5c318be2273a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:01.392748 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c33201f7-236f-4ffc-b132-5c318be2273a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:01.787557 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-3d6c424e-2f17-42ed-9145-a49cda4d7ab0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:01.803872 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-3d6c424e-2f17-42ed-9145-a49cda4d7ab0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:01.805699 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-3d6c424e-2f17-42ed-9145-a49cda4d7ab0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:01.809258 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-3d6c424e-2f17-42ed-9145-a49cda4d7ab0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1405 microversion: 2.20 time: 1.161645 Feb 19 02:27:01.826964 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 51/108] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:27:00 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1405 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:27:01.836557 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-e5d13433-5b15-4e17-b25c-c74b6abf3789 req-1c9f00c8-44a9-409b-ab57-fbb673f71f5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42f746d8-04b6-4db3-a823-ecff5e8dab6b", "tag": "d5caccc3-33c1-47a3-b424-89ffc91a1700"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:01.842082 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:27:01.842082 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:27:01.865584 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-e5d13433-5b15-4e17-b25c-c74b6abf3789 req-1c9f00c8-44a9-409b-ab57-fbb673f71f5a service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:01.866081 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-e5d13433-5b15-4e17-b25c-c74b6abf3789 req-1c9f00c8-44a9-409b-ab57-fbb673f71f5a service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:01.874977 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c33201f7-236f-4ffc-b132-5c318be2273a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:01.887523 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c33201f7-236f-4ffc-b132-5c318be2273a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1362 microversion: 2.1 time: 0.522805 Feb 19 02:27:01.898215 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 58/109] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:01 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1362 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:01.942317 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-e5d13433-5b15-4e17-b25c-c74b6abf3789 req-1c9f00c8-44a9-409b-ab57-fbb673f71f5a service nova] Creating event network-changed:d5caccc3-33c1-47a3-b424-89ffc91a1700 for instance 42f746d8-04b6-4db3-a823-ecff5e8dab6b on hv-cinder-77642 Feb 19 02:27:01.949615 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-e5d13433-5b15-4e17-b25c-c74b6abf3789 req-1c9f00c8-44a9-409b-ab57-fbb673f71f5a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120262 Feb 19 02:27:01.955414 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 52/110] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:27:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:27:02.393483 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-3b830171-3cd4-4b15-834f-885af8b5577d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:02.394967 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-3b830171-3cd4-4b15-834f-885af8b5577d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:02.403783 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3b830171-3cd4-4b15-834f-885af8b5577d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:02.404569 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3b830171-3cd4-4b15-834f-885af8b5577d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:02.405614 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3b830171-3cd4-4b15-834f-885af8b5577d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:02.406300 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3b830171-3cd4-4b15-834f-885af8b5577d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:02.836369 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-27e52d1a-623b-440e-a151-b4125ac275d3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:02.837138 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-27e52d1a-623b-440e-a151-b4125ac275d3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:02.847636 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-27e52d1a-623b-440e-a151-b4125ac275d3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:02.848616 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-27e52d1a-623b-440e-a151-b4125ac275d3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:02.849703 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-27e52d1a-623b-440e-a151-b4125ac275d3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:02.850447 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-27e52d1a-623b-440e-a151-b4125ac275d3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:02.893349 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-3b830171-3cd4-4b15-834f-885af8b5577d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:02.908049 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-3b830171-3cd4-4b15-834f-885af8b5577d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1521 microversion: 2.1 time: 0.522800 Feb 19 02:27:02.910487 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 59/111] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:02 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1521 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:02.929434 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f255c633-132d-4631-bbe6-9e8d5bba44ed tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:02.930125 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f255c633-132d-4631-bbe6-9e8d5bba44ed tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:02.952379 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f255c633-132d-4631-bbe6-9e8d5bba44ed tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:02.952886 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f255c633-132d-4631-bbe6-9e8d5bba44ed tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:02.953742 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f255c633-132d-4631-bbe6-9e8d5bba44ed tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:02.954232 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f255c633-132d-4631-bbe6-9e8d5bba44ed tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:03.546218 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f255c633-132d-4631-bbe6-9e8d5bba44ed tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:03.577506 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f255c633-132d-4631-bbe6-9e8d5bba44ed tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1362 microversion: 2.1 time: 0.654320 Feb 19 02:27:03.580370 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 60/112] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:02 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1362 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:27:03.926745 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1e639744-363b-4ec5-b88e-a92272fa0f82 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:03.927535 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1e639744-363b-4ec5-b88e-a92272fa0f82 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:03.942831 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1e639744-363b-4ec5-b88e-a92272fa0f82 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:03.945417 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1e639744-363b-4ec5-b88e-a92272fa0f82 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:03.950226 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1e639744-363b-4ec5-b88e-a92272fa0f82 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:03.950907 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1e639744-363b-4ec5-b88e-a92272fa0f82 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:04.112428 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-27e52d1a-623b-440e-a151-b4125ac275d3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:04.133242 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-27e52d1a-623b-440e-a151-b4125ac275d3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:04.139137 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-27e52d1a-623b-440e-a151-b4125ac275d3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:04.139137 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-27e52d1a-623b-440e-a151-b4125ac275d3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1597 microversion: 2.20 time: 1.305444 Feb 19 02:27:04.154502 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 53/113] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:27:02 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1597 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:27:04.160883 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b717e3de-02c2-4002-9ae3-84fa5003c160 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:04.161615 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b717e3de-02c2-4002-9ae3-84fa5003c160 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:04.176495 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b717e3de-02c2-4002-9ae3-84fa5003c160 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:04.177004 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b717e3de-02c2-4002-9ae3-84fa5003c160 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:04.177859 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b717e3de-02c2-4002-9ae3-84fa5003c160 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:04.178345 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b717e3de-02c2-4002-9ae3-84fa5003c160 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:04.527920 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b717e3de-02c2-4002-9ae3-84fa5003c160 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.370142 Feb 19 02:27:04.529100 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 54/114] 10.222.0.44 () {60 vars in 1306 bytes} [Fri Feb 19 02:27:04 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/os-interface => generated 285 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:27:04.602239 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-66c3665b-8768-424b-87f7-41476953e751 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:04.603805 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-66c3665b-8768-424b-87f7-41476953e751 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:04.615040 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-66c3665b-8768-424b-87f7-41476953e751 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:04.615770 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-66c3665b-8768-424b-87f7-41476953e751 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:04.616815 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-66c3665b-8768-424b-87f7-41476953e751 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:04.617501 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-66c3665b-8768-424b-87f7-41476953e751 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:05.002878 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-66c3665b-8768-424b-87f7-41476953e751 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:05.018278 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-66c3665b-8768-424b-87f7-41476953e751 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1362 microversion: 2.1 time: 0.417188 Feb 19 02:27:05.029699 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 55/115] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:04 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1362 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:27:05.094581 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-1e639744-363b-4ec5-b88e-a92272fa0f82 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:05.104564 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1e639744-363b-4ec5-b88e-a92272fa0f82 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1521 microversion: 2.1 time: 1.183059 Feb 19 02:27:05.105447 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 61/116] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:03 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1521 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:06.038162 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-0447e816-8e0f-48c1-8fbb-06ff3bb34d08 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:06.038872 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-0447e816-8e0f-48c1-8fbb-06ff3bb34d08 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:06.057939 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0447e816-8e0f-48c1-8fbb-06ff3bb34d08 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:06.064178 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0447e816-8e0f-48c1-8fbb-06ff3bb34d08 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:06.065518 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0447e816-8e0f-48c1-8fbb-06ff3bb34d08 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:06.066895 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0447e816-8e0f-48c1-8fbb-06ff3bb34d08 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:06.123889 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7aeee072-842e-4b32-b2ba-7a25ce37de68 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:06.124570 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7aeee072-842e-4b32-b2ba-7a25ce37de68 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:06.145938 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7aeee072-842e-4b32-b2ba-7a25ce37de68 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:06.149218 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7aeee072-842e-4b32-b2ba-7a25ce37de68 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:06.150174 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7aeee072-842e-4b32-b2ba-7a25ce37de68 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:06.150687 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7aeee072-842e-4b32-b2ba-7a25ce37de68 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:06.435020 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-0447e816-8e0f-48c1-8fbb-06ff3bb34d08 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:06.445817 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-0447e816-8e0f-48c1-8fbb-06ff3bb34d08 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1362 microversion: 2.1 time: 0.412076 Feb 19 02:27:06.446307 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 56/117] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:06 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1362 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:06.959763 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7aeee072-842e-4b32-b2ba-7a25ce37de68 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:06.980544 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7aeee072-842e-4b32-b2ba-7a25ce37de68 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1521 microversion: 2.1 time: 0.858407 Feb 19 02:27:06.980544 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 62/118] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:06 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1521 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:07.482247 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-cc40ca28-214e-4f76-815b-2f32fd516d17 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:07.482954 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-cc40ca28-214e-4f76-815b-2f32fd516d17 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:07.498813 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cc40ca28-214e-4f76-815b-2f32fd516d17 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:07.499324 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cc40ca28-214e-4f76-815b-2f32fd516d17 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:07.500199 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cc40ca28-214e-4f76-815b-2f32fd516d17 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:07.500693 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cc40ca28-214e-4f76-815b-2f32fd516d17 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:07.593167 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b3589d15-14f6-4da5-95d2-d78a517f1b24 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:07.594328 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b3589d15-14f6-4da5-95d2-d78a517f1b24 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:07.606853 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b3589d15-14f6-4da5-95d2-d78a517f1b24 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:07.607547 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b3589d15-14f6-4da5-95d2-d78a517f1b24 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:07.609961 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b3589d15-14f6-4da5-95d2-d78a517f1b24 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:07.610635 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b3589d15-14f6-4da5-95d2-d78a517f1b24 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:07.764585 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b3589d15-14f6-4da5-95d2-d78a517f1b24 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 14 microversion: 2.20 time: 0.175908 Feb 19 02:27:07.769459 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 63/119] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:07 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 14 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:27:07.778259 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-e2b70362-0fa5-4b47-a47b-67d1a58fdedd req-23428f9d-f564-4d68-ad8f-6f259612e051 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5265f377-f5b9-4f2c-a6e8-3bf64fb08733", "tag": "f7dc3053-2f41-4450-982f-60c5d1f56ee3"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:07.781315 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:27:07.781315 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:27:07.791853 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-e2b70362-0fa5-4b47-a47b-67d1a58fdedd req-23428f9d-f564-4d68-ad8f-6f259612e051 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:07.792710 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-e2b70362-0fa5-4b47-a47b-67d1a58fdedd req-23428f9d-f564-4d68-ad8f-6f259612e051 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:07.812531 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-e2b70362-0fa5-4b47-a47b-67d1a58fdedd req-23428f9d-f564-4d68-ad8f-6f259612e051 service nova] Creating event network-changed:f7dc3053-2f41-4450-982f-60c5d1f56ee3 for instance 5265f377-f5b9-4f2c-a6e8-3bf64fb08733 on hv-cinder-77642 Feb 19 02:27:07.818454 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-e2b70362-0fa5-4b47-a47b-67d1a58fdedd req-23428f9d-f564-4d68-ad8f-6f259612e051 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046092 Feb 19 02:27:07.819369 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 64/120] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:27:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:27:07.932782 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-cc40ca28-214e-4f76-815b-2f32fd516d17 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:07.954321 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-cc40ca28-214e-4f76-815b-2f32fd516d17 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1362 microversion: 2.1 time: 0.476666 Feb 19 02:27:07.957049 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 57/121] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:07 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1362 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:07.999576 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4e7e0fe9-547e-468c-8609-d8460b0b2dac tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:08.001512 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-4e7e0fe9-547e-468c-8609-d8460b0b2dac tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:08.021762 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4e7e0fe9-547e-468c-8609-d8460b0b2dac tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:08.022593 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4e7e0fe9-547e-468c-8609-d8460b0b2dac tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:08.023687 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4e7e0fe9-547e-468c-8609-d8460b0b2dac tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:08.024382 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4e7e0fe9-547e-468c-8609-d8460b0b2dac tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:08.381273 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-e290dd06-3db4-44bc-bedd-c5b324a5b3fb req-5ac3cea1-0481-424a-a8b9-785547a4e551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42f746d8-04b6-4db3-a823-ecff5e8dab6b", "name": "network-vif-plugged", "status": "completed", "tag": "d5caccc3-33c1-47a3-b424-89ffc91a1700"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:08.383042 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:27:08.383042 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:27:08.412542 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-e290dd06-3db4-44bc-bedd-c5b324a5b3fb req-5ac3cea1-0481-424a-a8b9-785547a4e551 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:08.413062 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-e290dd06-3db4-44bc-bedd-c5b324a5b3fb req-5ac3cea1-0481-424a-a8b9-785547a4e551 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:08.478671 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-e290dd06-3db4-44bc-bedd-c5b324a5b3fb req-5ac3cea1-0481-424a-a8b9-785547a4e551 service nova] Creating event network-vif-plugged:d5caccc3-33c1-47a3-b424-89ffc91a1700 for instance 42f746d8-04b6-4db3-a823-ecff5e8dab6b on hv-cinder-77642 Feb 19 02:27:08.503002 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-e290dd06-3db4-44bc-bedd-c5b324a5b3fb req-5ac3cea1-0481-424a-a8b9-785547a4e551 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122222 Feb 19 02:27:08.503436 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 58/122] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:27:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:27:08.707245 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-4e7e0fe9-547e-468c-8609-d8460b0b2dac tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:08.721973 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-4e7e0fe9-547e-468c-8609-d8460b0b2dac tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1521 microversion: 2.1 time: 0.728870 Feb 19 02:27:08.734303 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 65/123] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:07 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1521 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:08.780176 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a7e3f23e-528f-4b82-860d-c607af598144 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:08.781861 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a7e3f23e-528f-4b82-860d-c607af598144 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:08.794690 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a7e3f23e-528f-4b82-860d-c607af598144 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:08.795541 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a7e3f23e-528f-4b82-860d-c607af598144 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:08.796788 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a7e3f23e-528f-4b82-860d-c607af598144 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:08.797825 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a7e3f23e-528f-4b82-860d-c607af598144 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:08.975973 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-18a4bb9a-cb92-4393-93ce-9972b67cf96a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:08.976900 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-18a4bb9a-cb92-4393-93ce-9972b67cf96a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:09.009982 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-18a4bb9a-cb92-4393-93ce-9972b67cf96a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:09.011237 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a7e3f23e-528f-4b82-860d-c607af598144 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 14 microversion: 2.20 time: 0.236786 Feb 19 02:27:09.012991 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 59/124] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:08 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 14 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:09.014693 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-18a4bb9a-cb92-4393-93ce-9972b67cf96a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:09.015603 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-18a4bb9a-cb92-4393-93ce-9972b67cf96a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:09.016102 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-18a4bb9a-cb92-4393-93ce-9972b67cf96a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:09.594268 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-18a4bb9a-cb92-4393-93ce-9972b67cf96a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:09.609646 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-18a4bb9a-cb92-4393-93ce-9972b67cf96a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1362 microversion: 2.1 time: 0.637667 Feb 19 02:27:09.611085 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 66/125] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:08 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1362 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:09.741705 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-3d62b129-9516-4941-8f76-5cbd051c69cd tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:09.742875 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-3d62b129-9516-4941-8f76-5cbd051c69cd tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:09.762176 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3d62b129-9516-4941-8f76-5cbd051c69cd tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:09.762817 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3d62b129-9516-4941-8f76-5cbd051c69cd tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:09.763760 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3d62b129-9516-4941-8f76-5cbd051c69cd tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:09.764354 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3d62b129-9516-4941-8f76-5cbd051c69cd tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:10.023967 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-17653eb7-819b-4c74-a4a6-5920590e303c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:10.025020 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-17653eb7-819b-4c74-a4a6-5920590e303c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:10.036454 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-3d62b129-9516-4941-8f76-5cbd051c69cd tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:10.041258 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-17653eb7-819b-4c74-a4a6-5920590e303c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:10.041782 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-17653eb7-819b-4c74-a4a6-5920590e303c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:10.042711 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-17653eb7-819b-4c74-a4a6-5920590e303c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:10.045191 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-17653eb7-819b-4c74-a4a6-5920590e303c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:10.049218 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-3d62b129-9516-4941-8f76-5cbd051c69cd tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1521 microversion: 2.1 time: 0.312127 Feb 19 02:27:10.050538 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 60/126] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:09 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:10.188484 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-17653eb7-819b-4c74-a4a6-5920590e303c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 14 microversion: 2.20 time: 0.167684 Feb 19 02:27:10.189678 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 67/127] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:10 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 14 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:10.631688 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-125c2084-ee2d-4324-bfb3-2609e036e49d tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:10.633185 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-125c2084-ee2d-4324-bfb3-2609e036e49d tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:10.646237 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-125c2084-ee2d-4324-bfb3-2609e036e49d tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:10.652225 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-125c2084-ee2d-4324-bfb3-2609e036e49d tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:10.653808 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-125c2084-ee2d-4324-bfb3-2609e036e49d tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:10.655928 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-125c2084-ee2d-4324-bfb3-2609e036e49d tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:10.767008 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-fcb26354-d855-4821-9e39-5943fe40beec tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-939491497", "imageRef": "37a0f9d8-d3f7-417e-bce6-371e41a47c88", "flavorRef": "452", "networks": [{"uuid": "fd54f352-2984-4a61-b9ca-5bbc66d3aa9f"}]}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:10.861113 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-fcb26354-d855-4821-9e39-5943fe40beec tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] validate_networks() for [('fd54f352-2984-4a61-b9ca-5bbc66d3aa9f', None, None, None)] {{(pid=98193) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 02:27:11.070036 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-125c2084-ee2d-4324-bfb3-2609e036e49d tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:11.081365 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-125c2084-ee2d-4324-bfb3-2609e036e49d tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1362 microversion: 2.1 time: 0.453547 Feb 19 02:27:11.082166 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 61/128] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:10 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1362 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:11.096451 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1d7730f8-03d5-45dd-bf48-3d3657a8d97b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:11.097189 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1d7730f8-03d5-45dd-bf48-3d3657a8d97b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:11.107141 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1d7730f8-03d5-45dd-bf48-3d3657a8d97b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:11.107750 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1d7730f8-03d5-45dd-bf48-3d3657a8d97b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:11.108679 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1d7730f8-03d5-45dd-bf48-3d3657a8d97b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:11.109175 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1d7730f8-03d5-45dd-bf48-3d3657a8d97b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:11.358615 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-1d7730f8-03d5-45dd-bf48-3d3657a8d97b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:11.368348 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1d7730f8-03d5-45dd-bf48-3d3657a8d97b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1521 microversion: 2.1 time: 0.280239 Feb 19 02:27:11.369378 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 62/129] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:11 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:11.375187 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1a6603e7-5fa0-472d-ac23-7a0b696b5339 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:11.376551 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1a6603e7-5fa0-472d-ac23-7a0b696b5339 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:11.385077 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1a6603e7-5fa0-472d-ac23-7a0b696b5339 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:11.386090 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1a6603e7-5fa0-472d-ac23-7a0b696b5339 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:11.387498 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1a6603e7-5fa0-472d-ac23-7a0b696b5339 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:11.388126 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1a6603e7-5fa0-472d-ac23-7a0b696b5339 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:11.528116 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1a6603e7-5fa0-472d-ac23-7a0b696b5339 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 14 microversion: 2.20 time: 0.157116 Feb 19 02:27:11.529327 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 63/130] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:11 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:11.612487 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-fcb26354-d855-4821-9e39-5943fe40beec tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Flavor limits 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 02:27:11.613115 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-fcb26354-d855-4821-9e39-5943fe40beec tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Image limits 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 02:27:11.614074 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-fcb26354-d855-4821-9e39-5943fe40beec tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Flavor pref 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 02:27:11.615024 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-fcb26354-d855-4821-9e39-5943fe40beec tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Image pref 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 02:27:11.615677 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-fcb26354-d855-4821-9e39-5943fe40beec tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 02:27:11.627820 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fcb26354-d855-4821-9e39-5943fe40beec tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:11.628609 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fcb26354-d855-4821-9e39-5943fe40beec tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:11.629791 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fcb26354-d855-4821-9e39-5943fe40beec tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:11.630480 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fcb26354-d855-4821-9e39-5943fe40beec tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:11.654210 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-fcb26354-d855-4821-9e39-5943fe40beec tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Getting quotas for project bf138e653b034c909eb38d6f109c2c4b. Resources: {'ram', 'instances', 'cores'} {{(pid=98193) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:27:11.659400 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-fcb26354-d855-4821-9e39-5943fe40beec tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Getting quotas for user 50e5a3cbcd6e4b73badbf6ca8db58941 and project bf138e653b034c909eb38d6f109c2c4b. Resources: {'ram', 'instances', 'cores'} {{(pid=98193) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:27:11.673371 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-fcb26354-d855-4821-9e39-5943fe40beec tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Going to run 1 instances... {{(pid=98193) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 02:27:11.676271 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-fcb26354-d855-4821-9e39-5943fe40beec tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37a0f9d8-d3f7-417e-bce6-371e41a47c88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 02:27:11.732801 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-fcb26354-d855-4821-9e39-5943fe40beec tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.970140 Feb 19 02:27:11.733712 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 68/131] 10.222.0.44 () {60 vars in 1137 bytes} [Fri Feb 19 02:27:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 02:27:11.746128 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-884d03dd-3160-41a1-8926-42979cdd473f tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:11.747316 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-884d03dd-3160-41a1-8926-42979cdd473f tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:11.840721 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-884d03dd-3160-41a1-8926-42979cdd473f tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:11.850529 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-884d03dd-3160-41a1-8926-42979cdd473f tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4" status: 200 len: 1217 microversion: 2.1 time: 0.109362 Feb 19 02:27:11.852438 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 64/132] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:11 2021] GET /compute/v2.1/servers/cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4 => generated 1217 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:12.101306 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8e6d5a55-cb34-40b2-b312-841cc293fab6 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:12.101981 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8e6d5a55-cb34-40b2-b312-841cc293fab6 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:12.118025 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8e6d5a55-cb34-40b2-b312-841cc293fab6 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:12.119003 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8e6d5a55-cb34-40b2-b312-841cc293fab6 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:12.120487 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8e6d5a55-cb34-40b2-b312-841cc293fab6 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:12.121362 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8e6d5a55-cb34-40b2-b312-841cc293fab6 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:12.376433 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8e6d5a55-cb34-40b2-b312-841cc293fab6 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:12.387660 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8e6d5a55-cb34-40b2-b312-841cc293fab6 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1547 microversion: 2.1 time: 0.290794 Feb 19 02:27:12.393012 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-51256096-9cd9-494f-a98b-3b6028a04711 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:12.393012 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-51256096-9cd9-494f-a98b-3b6028a04711 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:12.393851 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 69/133] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:12 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1547 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:12.405140 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-51256096-9cd9-494f-a98b-3b6028a04711 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:12.405805 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-51256096-9cd9-494f-a98b-3b6028a04711 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:12.406811 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-51256096-9cd9-494f-a98b-3b6028a04711 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:12.407521 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-51256096-9cd9-494f-a98b-3b6028a04711 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:12.408899 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d0f6d22e-335e-4824-8f51-d1a0b425a31a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:12.409446 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d0f6d22e-335e-4824-8f51-d1a0b425a31a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:12.418720 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d0f6d22e-335e-4824-8f51-d1a0b425a31a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:12.419225 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d0f6d22e-335e-4824-8f51-d1a0b425a31a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:12.420067 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d0f6d22e-335e-4824-8f51-d1a0b425a31a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:12.420558 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d0f6d22e-335e-4824-8f51-d1a0b425a31a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:12.666522 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-51256096-9cd9-494f-a98b-3b6028a04711 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:12.677732 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-51256096-9cd9-494f-a98b-3b6028a04711 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1521 microversion: 2.1 time: 0.293897 Feb 19 02:27:12.689790 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 65/134] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:12 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:12.689914 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d0f6d22e-335e-4824-8f51-d1a0b425a31a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.285318 Feb 19 02:27:12.690735 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 70/135] 10.222.0.44 () {58 vars in 1265 bytes} [Fri Feb 19 02:27:12 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/os-interface => generated 284 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:27:12.695294 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f8ab4eb8-3caf-427f-ab8b-972386ad2018 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:12.696340 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f8ab4eb8-3caf-427f-ab8b-972386ad2018 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:12.706691 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f8ab4eb8-3caf-427f-ab8b-972386ad2018 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:12.708624 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f8ab4eb8-3caf-427f-ab8b-972386ad2018 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:12.711006 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f8ab4eb8-3caf-427f-ab8b-972386ad2018 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:12.711702 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f8ab4eb8-3caf-427f-ab8b-972386ad2018 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:12.848921 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f8ab4eb8-3caf-427f-ab8b-972386ad2018 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 14 microversion: 2.20 time: 0.157589 Feb 19 02:27:12.849803 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 66/136] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:12 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:12.871424 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-0971a418-e3c9-4eb5-b1e8-b58e95ae2c13 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:12.872459 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-0971a418-e3c9-4eb5-b1e8-b58e95ae2c13 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:12.880630 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0971a418-e3c9-4eb5-b1e8-b58e95ae2c13 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:12.881465 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0971a418-e3c9-4eb5-b1e8-b58e95ae2c13 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:12.882521 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0971a418-e3c9-4eb5-b1e8-b58e95ae2c13 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:12.883198 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0971a418-e3c9-4eb5-b1e8-b58e95ae2c13 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:13.034214 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-0971a418-e3c9-4eb5-b1e8-b58e95ae2c13 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:13.044546 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-0971a418-e3c9-4eb5-b1e8-b58e95ae2c13 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4" status: 200 len: 1269 microversion: 2.1 time: 0.176847 Feb 19 02:27:13.045190 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 71/137] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:12 2021] GET /compute/v2.1/servers/cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4 => generated 1269 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:13.697653 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-84fd5684-b610-4b2c-9a8c-0c234af8bf69 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:13.699649 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-84fd5684-b610-4b2c-9a8c-0c234af8bf69 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:13.710732 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-84fd5684-b610-4b2c-9a8c-0c234af8bf69 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:13.711447 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-84fd5684-b610-4b2c-9a8c-0c234af8bf69 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:13.713074 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-84fd5684-b610-4b2c-9a8c-0c234af8bf69 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:13.713888 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-84fd5684-b610-4b2c-9a8c-0c234af8bf69 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:13.861385 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f8e928f9-3570-4c2b-9418-a6540a6d2333 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:13.862727 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f8e928f9-3570-4c2b-9418-a6540a6d2333 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:13.883496 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f8e928f9-3570-4c2b-9418-a6540a6d2333 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:13.883990 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f8e928f9-3570-4c2b-9418-a6540a6d2333 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:13.886267 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f8e928f9-3570-4c2b-9418-a6540a6d2333 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:13.887101 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f8e928f9-3570-4c2b-9418-a6540a6d2333 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:14.085590 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f8e928f9-3570-4c2b-9418-a6540a6d2333 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 14 microversion: 2.20 time: 0.228312 Feb 19 02:27:14.086926 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 72/138] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:13 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 14 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:27:14.094178 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-092aa3f0-874f-496a-868c-929963180f0d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:14.094414 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-092aa3f0-874f-496a-868c-929963180f0d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:14.104035 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-092aa3f0-874f-496a-868c-929963180f0d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:14.105117 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-092aa3f0-874f-496a-868c-929963180f0d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:14.106202 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-092aa3f0-874f-496a-868c-929963180f0d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:14.106795 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-092aa3f0-874f-496a-868c-929963180f0d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:14.266346 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-092aa3f0-874f-496a-868c-929963180f0d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:14.277024 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-092aa3f0-874f-496a-868c-929963180f0d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4" status: 200 len: 1275 microversion: 2.1 time: 0.188083 Feb 19 02:27:14.278390 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 73/139] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:14 2021] GET /compute/v2.1/servers/cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4 => generated 1275 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:14.582995 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-84fd5684-b610-4b2c-9a8c-0c234af8bf69 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:14.597802 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-84fd5684-b610-4b2c-9a8c-0c234af8bf69 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1521 microversion: 2.1 time: 0.904471 Feb 19 02:27:14.599019 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 67/140] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:13 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1521 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:15.097818 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-3e19290d-b968-4ff5-b346-978e4c059c60 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:15.098905 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-3e19290d-b968-4ff5-b346-978e4c059c60 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:15.117422 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3e19290d-b968-4ff5-b346-978e4c059c60 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:15.118095 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3e19290d-b968-4ff5-b346-978e4c059c60 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:15.118998 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3e19290d-b968-4ff5-b346-978e4c059c60 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:15.119495 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3e19290d-b968-4ff5-b346-978e4c059c60 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:15.285333 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-3e19290d-b968-4ff5-b346-978e4c059c60 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 14 microversion: 2.20 time: 0.191121 Feb 19 02:27:15.286703 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 74/141] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:15 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 14 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:15.298918 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c050382b-7737-4b74-8f8a-9388db28d4ec tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:15.299831 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c050382b-7737-4b74-8f8a-9388db28d4ec tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:15.312396 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c050382b-7737-4b74-8f8a-9388db28d4ec tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:15.313053 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c050382b-7737-4b74-8f8a-9388db28d4ec tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:15.314208 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c050382b-7737-4b74-8f8a-9388db28d4ec tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:15.315989 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c050382b-7737-4b74-8f8a-9388db28d4ec tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:15.618695 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-69860bae-e10b-40af-bc06-cde7269ac165 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:15.619552 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-69860bae-e10b-40af-bc06-cde7269ac165 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:15.631053 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-69860bae-e10b-40af-bc06-cde7269ac165 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:15.631484 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-69860bae-e10b-40af-bc06-cde7269ac165 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:15.632339 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-69860bae-e10b-40af-bc06-cde7269ac165 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:15.632840 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-69860bae-e10b-40af-bc06-cde7269ac165 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:15.869778 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c050382b-7737-4b74-8f8a-9388db28d4ec tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:15.883048 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c050382b-7737-4b74-8f8a-9388db28d4ec tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4" status: 200 len: 1317 microversion: 2.1 time: 0.591019 Feb 19 02:27:15.896087 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 68/142] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:15 2021] GET /compute/v2.1/servers/cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4 => generated 1317 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:15.899495 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e34df196-72a1-47bf-b74c-8ca8904746dd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:15.901078 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e34df196-72a1-47bf-b74c-8ca8904746dd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:15.931875 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e34df196-72a1-47bf-b74c-8ca8904746dd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:15.932425 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e34df196-72a1-47bf-b74c-8ca8904746dd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:15.933565 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e34df196-72a1-47bf-b74c-8ca8904746dd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:15.934071 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e34df196-72a1-47bf-b74c-8ca8904746dd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:16.153708 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e34df196-72a1-47bf-b74c-8ca8904746dd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 14 microversion: 2.1 time: 0.264055 Feb 19 02:27:16.154899 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 69/143] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:27:15 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 14 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:27:16.164125 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-03316398-37f2-41f6-809d-0f68607b8164 req-eae681de-f509-4e4e-b8e7-c7745a083d8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42f746d8-04b6-4db3-a823-ecff5e8dab6b", "tag": "d5caccc3-33c1-47a3-b424-89ffc91a1700"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:16.167175 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:27:16.167175 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:27:16.178485 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-03316398-37f2-41f6-809d-0f68607b8164 req-eae681de-f509-4e4e-b8e7-c7745a083d8f service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:16.179298 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-03316398-37f2-41f6-809d-0f68607b8164 req-eae681de-f509-4e4e-b8e7-c7745a083d8f service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:16.201475 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-03316398-37f2-41f6-809d-0f68607b8164 req-eae681de-f509-4e4e-b8e7-c7745a083d8f service nova] Creating event network-changed:d5caccc3-33c1-47a3-b424-89ffc91a1700 for instance 42f746d8-04b6-4db3-a823-ecff5e8dab6b on hv-cinder-77642 Feb 19 02:27:16.207898 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-03316398-37f2-41f6-809d-0f68607b8164 req-eae681de-f509-4e4e-b8e7-c7745a083d8f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051324 Feb 19 02:27:16.209615 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 70/144] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:27:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:27:16.277822 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-69860bae-e10b-40af-bc06-cde7269ac165 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:16.300036 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-833e56a3-941a-4fb2-afb6-2b65b9128be6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:16.301341 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-833e56a3-941a-4fb2-afb6-2b65b9128be6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:16.309608 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-69860bae-e10b-40af-bc06-cde7269ac165 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1521 microversion: 2.1 time: 0.691948 Feb 19 02:27:16.310284 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 75/145] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:15 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1521 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:16.342266 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-833e56a3-941a-4fb2-afb6-2b65b9128be6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:16.344759 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-833e56a3-941a-4fb2-afb6-2b65b9128be6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:16.345864 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-833e56a3-941a-4fb2-afb6-2b65b9128be6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:16.347824 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-833e56a3-941a-4fb2-afb6-2b65b9128be6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:16.500078 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-833e56a3-941a-4fb2-afb6-2b65b9128be6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 14 microversion: 2.20 time: 0.206216 Feb 19 02:27:16.500792 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 71/146] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:16 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 14 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:27:16.904753 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-04599b4a-273e-4155-bb75-ca6c94cfb44d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:16.906129 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-04599b4a-273e-4155-bb75-ca6c94cfb44d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:16.917232 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-04599b4a-273e-4155-bb75-ca6c94cfb44d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:16.918047 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-04599b4a-273e-4155-bb75-ca6c94cfb44d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:16.919143 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-04599b4a-273e-4155-bb75-ca6c94cfb44d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:16.919825 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-04599b4a-273e-4155-bb75-ca6c94cfb44d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:17.162644 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-7f541509-c694-4c06-9613-9b9a2d390f74 req-20d42ab8-dbfd-48a7-89c1-afffe0958d77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4", "tag": "278e34f1-4ef8-45d9-9318-24113c70b71c"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:17.167962 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:27:17.167962 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:27:17.196086 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-7f541509-c694-4c06-9613-9b9a2d390f74 req-20d42ab8-dbfd-48a7-89c1-afffe0958d77 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:17.196587 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-7f541509-c694-4c06-9613-9b9a2d390f74 req-20d42ab8-dbfd-48a7-89c1-afffe0958d77 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:17.225381 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-7f541509-c694-4c06-9613-9b9a2d390f74 req-20d42ab8-dbfd-48a7-89c1-afffe0958d77 service nova] Creating event network-changed:278e34f1-4ef8-45d9-9318-24113c70b71c for instance cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4 on hv-cinder-77642 Feb 19 02:27:17.231897 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-7f541509-c694-4c06-9613-9b9a2d390f74 req-20d42ab8-dbfd-48a7-89c1-afffe0958d77 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081765 Feb 19 02:27:17.232887 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 72/147] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:27:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:27:17.240633 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-3ae96d2d-08ad-4736-a390-d6e90f97bc5f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:17.241985 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-3ae96d2d-08ad-4736-a390-d6e90f97bc5f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:17.255319 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3ae96d2d-08ad-4736-a390-d6e90f97bc5f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:17.255319 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3ae96d2d-08ad-4736-a390-d6e90f97bc5f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:17.255319 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3ae96d2d-08ad-4736-a390-d6e90f97bc5f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:17.255319 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3ae96d2d-08ad-4736-a390-d6e90f97bc5f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:17.390745 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-3ae96d2d-08ad-4736-a390-d6e90f97bc5f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 14 microversion: 2.1 time: 0.156109 Feb 19 02:27:17.391444 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 73/148] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:27:17 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:27:17.399015 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-709ae88b-9ff3-4f3f-9347-dd14b367070b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:17.400469 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-709ae88b-9ff3-4f3f-9347-dd14b367070b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:17.424039 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-709ae88b-9ff3-4f3f-9347-dd14b367070b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:17.425461 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-709ae88b-9ff3-4f3f-9347-dd14b367070b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:17.427334 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-709ae88b-9ff3-4f3f-9347-dd14b367070b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:17.430048 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-709ae88b-9ff3-4f3f-9347-dd14b367070b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:17.545359 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-04599b4a-273e-4155-bb75-ca6c94cfb44d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:17.559383 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-04599b4a-273e-4155-bb75-ca6c94cfb44d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4" status: 200 len: 1317 microversion: 2.1 time: 0.659238 Feb 19 02:27:17.577031 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 76/149] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:16 2021] GET /compute/v2.1/servers/cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4 => generated 1317 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:17.599490 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-da249a7e-cde5-4b15-a64c-cb23f05c760e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:17.599490 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-da249a7e-cde5-4b15-a64c-cb23f05c760e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:17.620790 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-da249a7e-cde5-4b15-a64c-cb23f05c760e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:17.621455 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-da249a7e-cde5-4b15-a64c-cb23f05c760e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:17.622302 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-da249a7e-cde5-4b15-a64c-cb23f05c760e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:17.623031 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-da249a7e-cde5-4b15-a64c-cb23f05c760e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:17.752087 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-da249a7e-cde5-4b15-a64c-cb23f05c760e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 14 microversion: 2.20 time: 0.173268 Feb 19 02:27:17.752828 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 77/150] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:17 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 14 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:17.759303 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-17d92b9f-5440-42a1-9437-7fe582bdc551 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:17.761084 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-17d92b9f-5440-42a1-9437-7fe582bdc551 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:17.785733 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-17d92b9f-5440-42a1-9437-7fe582bdc551 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:17.787561 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-17d92b9f-5440-42a1-9437-7fe582bdc551 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:17.788481 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-17d92b9f-5440-42a1-9437-7fe582bdc551 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:17.788985 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-17d92b9f-5440-42a1-9437-7fe582bdc551 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:17.950469 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-17d92b9f-5440-42a1-9437-7fe582bdc551 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Going to try to terminate instance {{(pid=98193) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 02:27:18.144532 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-709ae88b-9ff3-4f3f-9347-dd14b367070b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:18.163031 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-709ae88b-9ff3-4f3f-9347-dd14b367070b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1521 microversion: 2.1 time: 0.769436 Feb 19 02:27:18.174217 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 74/151] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:17 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1521 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:18.212825 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-17d92b9f-5440-42a1-9437-7fe582bdc551 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da" status: 204 len: 0 microversion: 2.1 time: 0.458369 Feb 19 02:27:18.215667 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 78/152] 10.222.0.44 () {58 vars in 1229 bytes} [Fri Feb 19 02:27:17 2021] DELETE /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 02:27:18.224349 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-0f9acdec-1762-43bc-be99-635888431bdf tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:18.225186 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-0f9acdec-1762-43bc-be99-635888431bdf tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:18.238664 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0f9acdec-1762-43bc-be99-635888431bdf tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:18.239472 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0f9acdec-1762-43bc-be99-635888431bdf tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:18.240459 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0f9acdec-1762-43bc-be99-635888431bdf tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:18.241192 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0f9acdec-1762-43bc-be99-635888431bdf tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:18.404778 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ce1c9ab8-e5eb-4aad-8c6f-76ca9fc1f205 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:18.406491 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ce1c9ab8-e5eb-4aad-8c6f-76ca9fc1f205 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:18.427730 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ce1c9ab8-e5eb-4aad-8c6f-76ca9fc1f205 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:18.430184 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ce1c9ab8-e5eb-4aad-8c6f-76ca9fc1f205 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:18.432183 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ce1c9ab8-e5eb-4aad-8c6f-76ca9fc1f205 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:18.433944 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ce1c9ab8-e5eb-4aad-8c6f-76ca9fc1f205 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:18.639029 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ce1c9ab8-e5eb-4aad-8c6f-76ca9fc1f205 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 14 microversion: 2.1 time: 0.238383 Feb 19 02:27:18.640150 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 79/153] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:27:18 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 14 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 19 02:27:18.656583 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-740a32ef-22b2-45b1-876a-08a0b9fb2f9a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:18.657342 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-740a32ef-22b2-45b1-876a-08a0b9fb2f9a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:18.674792 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-740a32ef-22b2-45b1-876a-08a0b9fb2f9a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:18.686004 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-740a32ef-22b2-45b1-876a-08a0b9fb2f9a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:18.687462 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-740a32ef-22b2-45b1-876a-08a0b9fb2f9a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:18.688036 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-740a32ef-22b2-45b1-876a-08a0b9fb2f9a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:18.709421 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-0f9acdec-1762-43bc-be99-635888431bdf tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfeeed90aa346138d8c1d8c87a25572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d5cd11d3da467cafa26ca33bb4e830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:18.720952 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-0f9acdec-1762-43bc-be99-635888431bdf tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da" status: 200 len: 1554 microversion: 2.1 time: 0.500487 Feb 19 02:27:18.734648 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 75/154] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:18 2021] GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da => generated 1554 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:18.765464 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-2720fc84-3bb7-4987-95e8-11305fb751b9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:18.766552 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-2720fc84-3bb7-4987-95e8-11305fb751b9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:18.776636 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2720fc84-3bb7-4987-95e8-11305fb751b9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:18.777118 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2720fc84-3bb7-4987-95e8-11305fb751b9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:18.778158 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2720fc84-3bb7-4987-95e8-11305fb751b9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:18.781040 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2720fc84-3bb7-4987-95e8-11305fb751b9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:18.927538 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-2720fc84-3bb7-4987-95e8-11305fb751b9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 14 microversion: 2.20 time: 0.167377 Feb 19 02:27:18.933606 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 76/155] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:18 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 14 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:27:19.186475 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-99e14440-bf06-4f43-81ff-8944dafd1df5 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:19.189299 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-99e14440-bf06-4f43-81ff-8944dafd1df5 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:19.201275 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-99e14440-bf06-4f43-81ff-8944dafd1df5 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:19.202158 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-99e14440-bf06-4f43-81ff-8944dafd1df5 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:19.203274 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-99e14440-bf06-4f43-81ff-8944dafd1df5 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:19.204157 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-99e14440-bf06-4f43-81ff-8944dafd1df5 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:19.256837 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-740a32ef-22b2-45b1-876a-08a0b9fb2f9a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:19.266892 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-740a32ef-22b2-45b1-876a-08a0b9fb2f9a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4" status: 200 len: 1317 microversion: 2.1 time: 0.625191 Feb 19 02:27:19.267738 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 80/156] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:18 2021] GET /compute/v2.1/servers/cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4 => generated 1317 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:19.490485 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-99e14440-bf06-4f43-81ff-8944dafd1df5 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:19.506206 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-99e14440-bf06-4f43-81ff-8944dafd1df5 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1521 microversion: 2.1 time: 0.327371 Feb 19 02:27:19.507184 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 77/157] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:19 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:27:19.655162 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-09bf8ebb-f3a7-49ff-9c31-d076e5fc3b86 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:19.656616 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-09bf8ebb-f3a7-49ff-9c31-d076e5fc3b86 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:19.666490 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-09bf8ebb-f3a7-49ff-9c31-d076e5fc3b86 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:19.667834 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-09bf8ebb-f3a7-49ff-9c31-d076e5fc3b86 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:19.668932 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-09bf8ebb-f3a7-49ff-9c31-d076e5fc3b86 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:19.669869 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-09bf8ebb-f3a7-49ff-9c31-d076e5fc3b86 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:19.743973 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-234a5a13-81f6-41fc-8bc1-41a757c35e05 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:19.745791 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-234a5a13-81f6-41fc-8bc1-41a757c35e05 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:19.761447 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-234a5a13-81f6-41fc-8bc1-41a757c35e05 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:19.762771 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-234a5a13-81f6-41fc-8bc1-41a757c35e05 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:19.763830 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-234a5a13-81f6-41fc-8bc1-41a757c35e05 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:19.764331 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-234a5a13-81f6-41fc-8bc1-41a757c35e05 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:19.832132 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-09bf8ebb-f3a7-49ff-9c31-d076e5fc3b86 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 14 microversion: 2.1 time: 0.183143 Feb 19 02:27:19.832814 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 81/158] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:27:19 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 14 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:27:19.951277 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-59e84212-fd1e-495d-90b7-dae8e5514b4f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:19.955340 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-59e84212-fd1e-495d-90b7-dae8e5514b4f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:19.983413 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-59e84212-fd1e-495d-90b7-dae8e5514b4f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:19.984514 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-59e84212-fd1e-495d-90b7-dae8e5514b4f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:19.985524 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-59e84212-fd1e-495d-90b7-dae8e5514b4f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:19.990830 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-59e84212-fd1e-495d-90b7-dae8e5514b4f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:20.147028 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-234a5a13-81f6-41fc-8bc1-41a757c35e05 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfeeed90aa346138d8c1d8c87a25572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d5cd11d3da467cafa26ca33bb4e830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:20.160739 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-234a5a13-81f6-41fc-8bc1-41a757c35e05 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da" status: 200 len: 1554 microversion: 2.1 time: 0.420630 Feb 19 02:27:20.163626 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 78/159] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:19 2021] GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da => generated 1554 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:20.198157 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-59e84212-fd1e-495d-90b7-dae8e5514b4f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 1953 microversion: 2.20 time: 0.259469 Feb 19 02:27:20.199519 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 82/160] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:19 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 1953 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 02:27:20.288992 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-bfee4b29-6753-4894-b0b7-93a7c1efbfc3 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:20.289988 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-bfee4b29-6753-4894-b0b7-93a7c1efbfc3 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:20.306189 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bfee4b29-6753-4894-b0b7-93a7c1efbfc3 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:20.307062 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bfee4b29-6753-4894-b0b7-93a7c1efbfc3 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:20.308622 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bfee4b29-6753-4894-b0b7-93a7c1efbfc3 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:20.309465 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bfee4b29-6753-4894-b0b7-93a7c1efbfc3 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:20.530247 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-31fc1a31-18bf-4f5c-97c8-3f780cda0161 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:20.535445 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-31fc1a31-18bf-4f5c-97c8-3f780cda0161 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:20.561812 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-31fc1a31-18bf-4f5c-97c8-3f780cda0161 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:20.563228 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-31fc1a31-18bf-4f5c-97c8-3f780cda0161 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:20.565072 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-31fc1a31-18bf-4f5c-97c8-3f780cda0161 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:20.566254 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-31fc1a31-18bf-4f5c-97c8-3f780cda0161 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:20.762325 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-bfee4b29-6753-4894-b0b7-93a7c1efbfc3 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:20.794602 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-bfee4b29-6753-4894-b0b7-93a7c1efbfc3 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4" status: 200 len: 1317 microversion: 2.1 time: 0.512534 Feb 19 02:27:20.798892 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 79/161] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:20 2021] GET /compute/v2.1/servers/cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4 => generated 1317 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:27:20.845928 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-0b0d8e98-d396-4a54-ac6f-c480d93161aa tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:20.848519 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-0b0d8e98-d396-4a54-ac6f-c480d93161aa tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:20.866328 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0b0d8e98-d396-4a54-ac6f-c480d93161aa tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:20.867157 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0b0d8e98-d396-4a54-ac6f-c480d93161aa tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:20.868170 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0b0d8e98-d396-4a54-ac6f-c480d93161aa tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:20.868860 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0b0d8e98-d396-4a54-ac6f-c480d93161aa tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:21.020622 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-0b0d8e98-d396-4a54-ac6f-c480d93161aa tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 14 microversion: 2.1 time: 0.179164 Feb 19 02:27:21.027990 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 80/162] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:27:20 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 14 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:27:21.158997 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-31fc1a31-18bf-4f5c-97c8-3f780cda0161 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:21.186119 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-0bf6d6a7-5b7b-4aa5-ba73-7239ea06740e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:21.190037 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-0bf6d6a7-5b7b-4aa5-ba73-7239ea06740e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:21.191701 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-31fc1a31-18bf-4f5c-97c8-3f780cda0161 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1521 microversion: 2.1 time: 0.669692 Feb 19 02:27:21.215631 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 83/163] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:20 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1521 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:21.233751 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7172cc3f-7ded-4a93-a4af-f8afe0ceab4a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:21.235495 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7172cc3f-7ded-4a93-a4af-f8afe0ceab4a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:21.243624 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0bf6d6a7-5b7b-4aa5-ba73-7239ea06740e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:21.244359 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0bf6d6a7-5b7b-4aa5-ba73-7239ea06740e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:21.261995 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0bf6d6a7-5b7b-4aa5-ba73-7239ea06740e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:21.261995 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0bf6d6a7-5b7b-4aa5-ba73-7239ea06740e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:21.262835 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7172cc3f-7ded-4a93-a4af-f8afe0ceab4a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:21.263553 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7172cc3f-7ded-4a93-a4af-f8afe0ceab4a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:21.265138 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7172cc3f-7ded-4a93-a4af-f8afe0ceab4a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:21.265734 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7172cc3f-7ded-4a93-a4af-f8afe0ceab4a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:21.557536 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7172cc3f-7ded-4a93-a4af-f8afe0ceab4a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 10159 microversion: 2.20 time: 0.340179 Feb 19 02:27:21.558394 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 84/164] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:21 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 10159 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:27:21.652178 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-0bf6d6a7-5b7b-4aa5-ba73-7239ea06740e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfeeed90aa346138d8c1d8c87a25572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d5cd11d3da467cafa26ca33bb4e830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:21.664978 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-0bf6d6a7-5b7b-4aa5-ba73-7239ea06740e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da" status: 200 len: 1554 microversion: 2.1 time: 0.487706 Feb 19 02:27:21.665778 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 81/165] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:21 2021] GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da => generated 1554 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:21.818192 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-9e50ba1e-b425-4fe6-b3b5-ccf485879868 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:21.819207 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-9e50ba1e-b425-4fe6-b3b5-ccf485879868 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:21.848387 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9e50ba1e-b425-4fe6-b3b5-ccf485879868 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:21.849053 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9e50ba1e-b425-4fe6-b3b5-ccf485879868 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:21.850266 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9e50ba1e-b425-4fe6-b3b5-ccf485879868 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:21.850934 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9e50ba1e-b425-4fe6-b3b5-ccf485879868 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:21.954947 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-1f6ad038-24b6-41a4-a9e4-51759f32b3a8 req-11143300-1545-45c5-a0e3-8afa093e51fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4", "name": "network-vif-plugged", "status": "completed", "tag": "278e34f1-4ef8-45d9-9318-24113c70b71c"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:21.956884 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:27:21.956884 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:27:21.981816 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-1f6ad038-24b6-41a4-a9e4-51759f32b3a8 req-11143300-1545-45c5-a0e3-8afa093e51fe service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:21.982650 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-1f6ad038-24b6-41a4-a9e4-51759f32b3a8 req-11143300-1545-45c5-a0e3-8afa093e51fe service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:22.035392 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-1f6ad038-24b6-41a4-a9e4-51759f32b3a8 req-11143300-1545-45c5-a0e3-8afa093e51fe service nova] Creating event network-vif-plugged:278e34f1-4ef8-45d9-9318-24113c70b71c for instance cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4 on hv-cinder-77642 Feb 19 02:27:22.048094 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-1f6ad038-24b6-41a4-a9e4-51759f32b3a8 req-11143300-1545-45c5-a0e3-8afa093e51fe service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098211 Feb 19 02:27:22.052795 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 82/166] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:27:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:27:22.071940 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-34e88fef-261c-47b3-9534-956bcd160ccd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:22.073910 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-34e88fef-261c-47b3-9534-956bcd160ccd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:22.103621 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-34e88fef-261c-47b3-9534-956bcd160ccd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:22.105006 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-34e88fef-261c-47b3-9534-956bcd160ccd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:22.108433 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-34e88fef-261c-47b3-9534-956bcd160ccd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:22.109840 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-34e88fef-261c-47b3-9534-956bcd160ccd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:22.348202 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-34e88fef-261c-47b3-9534-956bcd160ccd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 14 microversion: 2.1 time: 0.293364 Feb 19 02:27:22.349267 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 83/167] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:27:22 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 14 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:27:22.360345 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-9e8e0d3d-775e-4142-8344-36fad30d9a3d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:22.362723 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-9e8e0d3d-775e-4142-8344-36fad30d9a3d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:22.403199 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9e8e0d3d-775e-4142-8344-36fad30d9a3d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:22.407472 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9e8e0d3d-775e-4142-8344-36fad30d9a3d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:22.408557 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9e8e0d3d-775e-4142-8344-36fad30d9a3d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:22.409199 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9e8e0d3d-775e-4142-8344-36fad30d9a3d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:22.712051 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9e50ba1e-b425-4fe6-b3b5-ccf485879868 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:22.731812 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-9e50ba1e-b425-4fe6-b3b5-ccf485879868 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4" status: 200 len: 1317 microversion: 2.1 time: 0.919127 Feb 19 02:27:22.733424 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 85/168] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:21 2021] GET /compute/v2.1/servers/cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4 => generated 1317 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:22.743634 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-69888547-b93f-42e5-8a10-cdcb62d88cab tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:22.744720 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-69888547-b93f-42e5-8a10-cdcb62d88cab tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:22.766017 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-69888547-b93f-42e5-8a10-cdcb62d88cab tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:22.766567 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-69888547-b93f-42e5-8a10-cdcb62d88cab tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:22.767410 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-69888547-b93f-42e5-8a10-cdcb62d88cab tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:22.767895 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-69888547-b93f-42e5-8a10-cdcb62d88cab tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:22.827630 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9e8e0d3d-775e-4142-8344-36fad30d9a3d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:22.837446 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-9e8e0d3d-775e-4142-8344-36fad30d9a3d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1521 microversion: 2.1 time: 0.486614 Feb 19 02:27:22.839040 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 84/169] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:22 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1521 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:22.845135 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5d51de3c-2465-48da-9802-cefee9920cd2 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:22.846114 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5d51de3c-2465-48da-9802-cefee9920cd2 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:22.867745 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5d51de3c-2465-48da-9802-cefee9920cd2 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:22.871481 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5d51de3c-2465-48da-9802-cefee9920cd2 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:22.872705 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5d51de3c-2465-48da-9802-cefee9920cd2 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:22.873581 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5d51de3c-2465-48da-9802-cefee9920cd2 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:23.035856 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-69888547-b93f-42e5-8a10-cdcb62d88cab tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 17348 microversion: 2.20 time: 0.301011 Feb 19 02:27:23.039808 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 86/170] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:22 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 17348 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:27:23.042203 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-a1a12165-a7a9-4343-9aa0-c048d8fe042b req-72e4a530-3eda-4fb4-a68c-d9162d075e8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e5b207a-9887-4414-9e31-577bab1ff7da", "name": "network-vif-deleted", "tag": "539d7478-42da-4489-996c-fb72328e93ff"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:23.043828 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:27:23.043828 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:27:23.090661 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5d51de3c-2465-48da-9802-cefee9920cd2 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfeeed90aa346138d8c1d8c87a25572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d5cd11d3da467cafa26ca33bb4e830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:23.093450 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-a1a12165-a7a9-4343-9aa0-c048d8fe042b req-72e4a530-3eda-4fb4-a68c-d9162d075e8e service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:23.094624 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-a1a12165-a7a9-4343-9aa0-c048d8fe042b req-72e4a530-3eda-4fb4-a68c-d9162d075e8e service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:23.102842 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5d51de3c-2465-48da-9802-cefee9920cd2 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da" status: 200 len: 1512 microversion: 2.1 time: 0.262309 Feb 19 02:27:23.107231 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 85/171] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:22 2021] GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da => generated 1512 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:23.139319 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-a1a12165-a7a9-4343-9aa0-c048d8fe042b req-72e4a530-3eda-4fb4-a68c-d9162d075e8e service nova] Creating event network-vif-deleted:539d7478-42da-4489-996c-fb72328e93ff for instance 7e5b207a-9887-4414-9e31-577bab1ff7da on hv-cinder-77642 Feb 19 02:27:23.144571 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-a1a12165-a7a9-4343-9aa0-c048d8fe042b req-72e4a530-3eda-4fb4-a68c-d9162d075e8e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106556 Feb 19 02:27:23.145762 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 87/172] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:27:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:27:23.361018 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f1f621be-8839-4c26-9adf-1323d2888cc0 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:23.362504 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f1f621be-8839-4c26-9adf-1323d2888cc0 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:23.371407 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f1f621be-8839-4c26-9adf-1323d2888cc0 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:23.371916 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f1f621be-8839-4c26-9adf-1323d2888cc0 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:23.372786 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f1f621be-8839-4c26-9adf-1323d2888cc0 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:23.373456 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f1f621be-8839-4c26-9adf-1323d2888cc0 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:23.497723 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f1f621be-8839-4c26-9adf-1323d2888cc0 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 14 microversion: 2.1 time: 0.140509 Feb 19 02:27:23.498639 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 86/173] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:27:23 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:27:23.756710 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-9a5dfbe5-4667-4ec9-a50a-8d4aab55943a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:23.758282 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-9a5dfbe5-4667-4ec9-a50a-8d4aab55943a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:23.775812 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a5dfbe5-4667-4ec9-a50a-8d4aab55943a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:23.788076 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a5dfbe5-4667-4ec9-a50a-8d4aab55943a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:23.789278 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a5dfbe5-4667-4ec9-a50a-8d4aab55943a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:23.789893 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a5dfbe5-4667-4ec9-a50a-8d4aab55943a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:23.859221 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-bab9b6b6-75c9-44fa-91c3-b0e177fcf84a tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:23.860230 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-bab9b6b6-75c9-44fa-91c3-b0e177fcf84a tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:23.884460 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bab9b6b6-75c9-44fa-91c3-b0e177fcf84a tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:23.888128 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bab9b6b6-75c9-44fa-91c3-b0e177fcf84a tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:23.890395 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bab9b6b6-75c9-44fa-91c3-b0e177fcf84a tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:23.893924 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bab9b6b6-75c9-44fa-91c3-b0e177fcf84a tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:24.177404 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9a5dfbe5-4667-4ec9-a50a-8d4aab55943a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:24.188681 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-9a5dfbe5-4667-4ec9-a50a-8d4aab55943a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4" status: 200 len: 1317 microversion: 2.1 time: 0.440324 Feb 19 02:27:24.189301 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 88/174] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:23 2021] GET /compute/v2.1/servers/cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4 => generated 1317 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:24.200127 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d8fcbbb3-6c8e-4458-996a-17324e3397ce tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:24.201305 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d8fcbbb3-6c8e-4458-996a-17324e3397ce tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:24.211236 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d8fcbbb3-6c8e-4458-996a-17324e3397ce tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:24.211889 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d8fcbbb3-6c8e-4458-996a-17324e3397ce tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:24.212851 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d8fcbbb3-6c8e-4458-996a-17324e3397ce tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:24.213466 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d8fcbbb3-6c8e-4458-996a-17324e3397ce tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:24.248917 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-bab9b6b6-75c9-44fa-91c3-b0e177fcf84a tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:24.260263 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-bab9b6b6-75c9-44fa-91c3-b0e177fcf84a tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1521 microversion: 2.1 time: 0.406204 Feb 19 02:27:24.261095 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 87/175] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:23 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1521 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:24.280542 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1da30ac0-f9a1-490e-940d-2886944d6b1e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:24.281186 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1da30ac0-f9a1-490e-940d-2886944d6b1e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:24.303617 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1da30ac0-f9a1-490e-940d-2886944d6b1e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:24.304420 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1da30ac0-f9a1-490e-940d-2886944d6b1e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:24.305781 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1da30ac0-f9a1-490e-940d-2886944d6b1e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:24.306267 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1da30ac0-f9a1-490e-940d-2886944d6b1e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:24.372139 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d8fcbbb3-6c8e-4458-996a-17324e3397ce tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 17960 microversion: 2.20 time: 0.176441 Feb 19 02:27:24.376294 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 89/176] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:24 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 17960 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:27:24.383416 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1da30ac0-f9a1-490e-940d-2886944d6b1e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:24.383922 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1da30ac0-f9a1-490e-940d-2886944d6b1e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:24.384428 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.objects.instance [None req-1da30ac0-f9a1-490e-940d-2886944d6b1e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lazy-loading 'fault' on Instance uuid 7e5b207a-9887-4414-9e31-577bab1ff7da {{(pid=98194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 02:27:24.454590 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-1da30ac0-f9a1-490e-940d-2886944d6b1e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfeeed90aa346138d8c1d8c87a25572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d5cd11d3da467cafa26ca33bb4e830', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:24.463751 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1da30ac0-f9a1-490e-940d-2886944d6b1e tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da" status: 200 len: 1305 microversion: 2.1 time: 0.187170 Feb 19 02:27:24.464379 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 88/177] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:24 2021] GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da => generated 1305 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:24.509305 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c6121bab-61c6-4268-b9e6-ddd30f92d5e3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:24.510524 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c6121bab-61c6-4268-b9e6-ddd30f92d5e3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:24.519200 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c6121bab-61c6-4268-b9e6-ddd30f92d5e3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:24.519714 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c6121bab-61c6-4268-b9e6-ddd30f92d5e3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:24.520552 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c6121bab-61c6-4268-b9e6-ddd30f92d5e3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:24.521039 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c6121bab-61c6-4268-b9e6-ddd30f92d5e3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:25.207226 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-560b39dd-ed4f-402d-a17c-23bf2ea80b00 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:25.207900 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-560b39dd-ed4f-402d-a17c-23bf2ea80b00 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:25.218738 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-560b39dd-ed4f-402d-a17c-23bf2ea80b00 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:25.219385 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-560b39dd-ed4f-402d-a17c-23bf2ea80b00 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:25.220230 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-560b39dd-ed4f-402d-a17c-23bf2ea80b00 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:25.220722 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-560b39dd-ed4f-402d-a17c-23bf2ea80b00 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:25.472626 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-560b39dd-ed4f-402d-a17c-23bf2ea80b00 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:25.481966 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-560b39dd-ed4f-402d-a17c-23bf2ea80b00 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4" status: 200 len: 1505 microversion: 2.1 time: 0.278811 Feb 19 02:27:25.482535 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 89/178] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:25 2021] GET /compute/v2.1/servers/cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4 => generated 1505 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:27:25.487167 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-58555814-2f0b-4428-b6d5-b461813df6da tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:25.488091 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-58555814-2f0b-4428-b6d5-b461813df6da tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:25.496313 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-58555814-2f0b-4428-b6d5-b461813df6da tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:25.496662 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-58555814-2f0b-4428-b6d5-b461813df6da tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:25.497496 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-58555814-2f0b-4428-b6d5-b461813df6da tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:25.497988 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-58555814-2f0b-4428-b6d5-b461813df6da tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:25.712566 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-58555814-2f0b-4428-b6d5-b461813df6da tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:25.721625 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-58555814-2f0b-4428-b6d5-b461813df6da tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1521 microversion: 2.1 time: 0.237949 Feb 19 02:27:25.722188 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 90/179] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:25 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:25.726984 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-25c3713c-3c38-4ca0-bd34-2fc6bf1e2d74 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:25.733269 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-25c3713c-3c38-4ca0-bd34-2fc6bf1e2d74 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:25.741262 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-25c3713c-3c38-4ca0-bd34-2fc6bf1e2d74 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:25.741772 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-25c3713c-3c38-4ca0-bd34-2fc6bf1e2d74 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:25.742620 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-25c3713c-3c38-4ca0-bd34-2fc6bf1e2d74 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:25.743117 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-25c3713c-3c38-4ca0-bd34-2fc6bf1e2d74 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:26.502026 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c6121bab-61c6-4268-b9e6-ddd30f92d5e3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 14 microversion: 2.1 time: 1.996884 Feb 19 02:27:26.502775 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 90/180] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:27:24 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 14 bytes in 1999 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:27:26.508111 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-90967b89-896a-42be-92e8-c99bf079f502 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:26.508915 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-90967b89-896a-42be-92e8-c99bf079f502 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:26.518008 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-90967b89-896a-42be-92e8-c99bf079f502 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:26.518570 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-90967b89-896a-42be-92e8-c99bf079f502 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:26.519415 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-90967b89-896a-42be-92e8-c99bf079f502 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:26.519916 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-90967b89-896a-42be-92e8-c99bf079f502 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:26.573645 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-90967b89-896a-42be-92e8-c99bf079f502 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] HTTP exception thrown: Instance 7e5b207a-9887-4414-9e31-577bab1ff7da could not be found. Feb 19 02:27:26.574313 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-90967b89-896a-42be-92e8-c99bf079f502 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Returning 404 to user: Instance 7e5b207a-9887-4414-9e31-577bab1ff7da could not be found. {{(pid=98193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:27:26.575507 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-90967b89-896a-42be-92e8-c99bf079f502 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da" status: 404 len: 111 microversion: 2.1 time: 0.071309 Feb 19 02:27:26.576127 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 91/181] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:26 2021] GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 02:27:26.582221 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-3d0e2108-fda8-47b6-9290-35a9e940a77d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68d881b9-67c9-49b5-a4d0-dfbb488cf711"}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:26.583559 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-3d0e2108-fda8-47b6-9290-35a9e940a77d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:26.592114 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3d0e2108-fda8-47b6-9290-35a9e940a77d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:26.592716 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3d0e2108-fda8-47b6-9290-35a9e940a77d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:26.593510 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3d0e2108-fda8-47b6-9290-35a9e940a77d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:26.594003 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3d0e2108-fda8-47b6-9290-35a9e940a77d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:26.764101 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-3d0e2108-fda8-47b6-9290-35a9e940a77d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] HTTP exception thrown: Invalid volume: volume 68d881b9-67c9-49b5-a4d0-dfbb488cf711 is already attached to instances: f4cde0d9-bb04-4e83-bc35-22f026ead5da Feb 19 02:27:26.764780 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-3d0e2108-fda8-47b6-9290-35a9e940a77d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Returning 400 to user: Invalid volume: volume 68d881b9-67c9-49b5-a4d0-dfbb488cf711 is already attached to instances: f4cde0d9-bb04-4e83-bc35-22f026ead5da {{(pid=98193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:27:26.765703 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-3d0e2108-fda8-47b6-9290-35a9e940a77d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "POST /compute/v2.1/servers/cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.188582 Feb 19 02:27:26.766325 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 92/182] 10.222.0.44 () {60 vars in 1313 bytes} [Fri Feb 19 02:27:26 2021] POST /compute/v2.1/servers/cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4/os-volume_attachments => generated 174 bytes in 190 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 02:27:26.772053 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-6aa8142e-5675-4c31-b320-2d7d21035f6f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:26.773084 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-6aa8142e-5675-4c31-b320-2d7d21035f6f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:26.782898 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6aa8142e-5675-4c31-b320-2d7d21035f6f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:26.783408 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6aa8142e-5675-4c31-b320-2d7d21035f6f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:26.784360 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6aa8142e-5675-4c31-b320-2d7d21035f6f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:26.784843 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6aa8142e-5675-4c31-b320-2d7d21035f6f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:27.005954 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-6aa8142e-5675-4c31-b320-2d7d21035f6f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:27.015576 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-6aa8142e-5675-4c31-b320-2d7d21035f6f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1521 microversion: 2.1 time: 0.247322 Feb 19 02:27:27.016209 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 93/183] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:26 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:27.025884 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d72048d2-94d5-48fa-b786-30eb802b70ad tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:27.025884 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d72048d2-94d5-48fa-b786-30eb802b70ad tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f4cde0d9-bb04-4e83-bc35-22f026ead5da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:27.029480 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d72048d2-94d5-48fa-b786-30eb802b70ad tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:27.029980 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d72048d2-94d5-48fa-b786-30eb802b70ad tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:27.030874 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d72048d2-94d5-48fa-b786-30eb802b70ad tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:27.031363 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d72048d2-94d5-48fa-b786-30eb802b70ad tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:27.219056 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.objects.instance [None req-d72048d2-94d5-48fa-b786-30eb802b70ad tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lazy-loading 'services' on Instance uuid f4cde0d9-bb04-4e83-bc35-22f026ead5da {{(pid=98193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 02:27:27.363555 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d72048d2-94d5-48fa-b786-30eb802b70ad tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da/os-volume_attachments/68d881b9-67c9-49b5-a4d0-dfbb488cf711" status: 202 len: 0 microversion: 2.1 time: 0.345890 Feb 19 02:27:27.364361 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 94/184] 10.222.0.44 () {58 vars in 1406 bytes} [Fri Feb 19 02:27:27 2021] DELETE /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da/os-volume_attachments/68d881b9-67c9-49b5-a4d0-dfbb488cf711 => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:27:27.515052 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8ce1b84a-e5d8-453e-9553-8ccf22a07d74 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:27.516312 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8ce1b84a-e5d8-453e-9553-8ccf22a07d74 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:27.524882 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8ce1b84a-e5d8-453e-9553-8ccf22a07d74 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:27.525410 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8ce1b84a-e5d8-453e-9553-8ccf22a07d74 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:27.526346 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8ce1b84a-e5d8-453e-9553-8ccf22a07d74 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:27.526883 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8ce1b84a-e5d8-453e-9553-8ccf22a07d74 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:27.645926 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-25c3713c-3c38-4ca0-bd34-2fc6bf1e2d74 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 22534 microversion: 2.20 time: 1.922323 Feb 19 02:27:27.646704 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 91/185] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:25 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 22534 bytes in 1924 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:27:27.685480 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8ce1b84a-e5d8-453e-9553-8ccf22a07d74 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 14 microversion: 2.1 time: 0.175476 Feb 19 02:27:27.686184 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 95/186] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:27:27 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 14 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 19 02:27:28.034396 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7876e32c-8520-4668-9a73-7e54fde3e8e6 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:28.035191 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7876e32c-8520-4668-9a73-7e54fde3e8e6 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:28.044190 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7876e32c-8520-4668-9a73-7e54fde3e8e6 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:28.044694 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7876e32c-8520-4668-9a73-7e54fde3e8e6 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:28.045688 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7876e32c-8520-4668-9a73-7e54fde3e8e6 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:28.046184 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7876e32c-8520-4668-9a73-7e54fde3e8e6 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:28.265051 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7876e32c-8520-4668-9a73-7e54fde3e8e6 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:28.273887 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7876e32c-8520-4668-9a73-7e54fde3e8e6 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1521 microversion: 2.1 time: 0.244096 Feb 19 02:27:28.274519 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 92/187] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:28 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:28.659838 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-84a9fd8e-97dc-497e-9a3b-c2e7b9feb00e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:28.661107 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-84a9fd8e-97dc-497e-9a3b-c2e7b9feb00e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:28.670081 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-84a9fd8e-97dc-497e-9a3b-c2e7b9feb00e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:28.670794 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-84a9fd8e-97dc-497e-9a3b-c2e7b9feb00e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:28.671634 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-84a9fd8e-97dc-497e-9a3b-c2e7b9feb00e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:28.672164 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-84a9fd8e-97dc-497e-9a3b-c2e7b9feb00e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:28.697254 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5675fdd4-b564-45c3-8c38-c87c5aa42b29 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:28.698937 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5675fdd4-b564-45c3-8c38-c87c5aa42b29 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:28.712474 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5675fdd4-b564-45c3-8c38-c87c5aa42b29 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:28.712960 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5675fdd4-b564-45c3-8c38-c87c5aa42b29 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:28.714554 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5675fdd4-b564-45c3-8c38-c87c5aa42b29 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:28.715215 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5675fdd4-b564-45c3-8c38-c87c5aa42b29 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:31.069079 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5675fdd4-b564-45c3-8c38-c87c5aa42b29 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 9596 microversion: 2.1 time: 2.375512 Feb 19 02:27:31.069711 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 93/188] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:27:28 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 9596 bytes in 2377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:31.075426 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-58a08ec4-db03-4644-93cd-276d19e0c6be tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:31.076186 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-58a08ec4-db03-4644-93cd-276d19e0c6be tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:31.084718 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-58a08ec4-db03-4644-93cd-276d19e0c6be tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:31.085225 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-58a08ec4-db03-4644-93cd-276d19e0c6be tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:31.086061 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-58a08ec4-db03-4644-93cd-276d19e0c6be tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:31.086583 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-58a08ec4-db03-4644-93cd-276d19e0c6be tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:31.092372 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-84a9fd8e-97dc-497e-9a3b-c2e7b9feb00e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 24248 microversion: 2.20 time: 2.436747 Feb 19 02:27:31.093094 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 96/189] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:28 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 24248 bytes in 2439 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:27:31.306240 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-58a08ec4-db03-4644-93cd-276d19e0c6be tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:31.315453 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-58a08ec4-db03-4644-93cd-276d19e0c6be tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1521 microversion: 2.1 time: 0.244256 Feb 19 02:27:31.316095 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 94/190] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:31 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:32.081957 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-62a22eef-50fe-4614-b1a1-1f712a7643eb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:32.083168 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-62a22eef-50fe-4614-b1a1-1f712a7643eb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:32.092478 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-62a22eef-50fe-4614-b1a1-1f712a7643eb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:32.092980 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-62a22eef-50fe-4614-b1a1-1f712a7643eb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:32.093827 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-62a22eef-50fe-4614-b1a1-1f712a7643eb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:32.094323 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-62a22eef-50fe-4614-b1a1-1f712a7643eb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:32.105349 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-36beb30b-1d9f-4688-b641-b32d736cbcac tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:32.106810 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-36beb30b-1d9f-4688-b641-b32d736cbcac tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:32.115830 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-36beb30b-1d9f-4688-b641-b32d736cbcac tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:32.116636 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-36beb30b-1d9f-4688-b641-b32d736cbcac tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:32.117588 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-36beb30b-1d9f-4688-b641-b32d736cbcac tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:32.118176 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-36beb30b-1d9f-4688-b641-b32d736cbcac tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:34.519930 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-62a22eef-50fe-4614-b1a1-1f712a7643eb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 17861 microversion: 2.1 time: 2.442185 Feb 19 02:27:34.520871 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 97/191] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:27:32 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 17861 bytes in 2444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:27:34.526190 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b81e88c0-5896-42b1-afa3-6065536ae86e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:34.526979 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b81e88c0-5896-42b1-afa3-6065536ae86e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:34.535530 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b81e88c0-5896-42b1-afa3-6065536ae86e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:34.536028 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b81e88c0-5896-42b1-afa3-6065536ae86e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:34.536865 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b81e88c0-5896-42b1-afa3-6065536ae86e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:34.537352 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b81e88c0-5896-42b1-afa3-6065536ae86e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:34.545166 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-36beb30b-1d9f-4688-b641-b32d736cbcac tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 26576 microversion: 2.20 time: 2.444355 Feb 19 02:27:34.545989 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 95/192] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:32 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 26576 bytes in 2446 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 19 02:27:34.752110 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b81e88c0-5896-42b1-afa3-6065536ae86e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:34.760929 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b81e88c0-5896-42b1-afa3-6065536ae86e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1521 microversion: 2.1 time: 0.238850 Feb 19 02:27:34.761540 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 98/193] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:34 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:35.533178 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-02165151-c7d0-44a9-aaf6-a22429add615 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:35.534450 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-02165151-c7d0-44a9-aaf6-a22429add615 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:35.544022 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-02165151-c7d0-44a9-aaf6-a22429add615 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:35.544618 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-02165151-c7d0-44a9-aaf6-a22429add615 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:35.545695 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-02165151-c7d0-44a9-aaf6-a22429add615 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:35.546251 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-02165151-c7d0-44a9-aaf6-a22429add615 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:35.558607 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f32ce473-d666-4852-a1a2-9e86a36a8605 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:35.559944 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f32ce473-d666-4852-a1a2-9e86a36a8605 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:35.569545 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f32ce473-d666-4852-a1a2-9e86a36a8605 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:35.570056 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f32ce473-d666-4852-a1a2-9e86a36a8605 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:35.570919 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f32ce473-d666-4852-a1a2-9e86a36a8605 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:35.571675 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f32ce473-d666-4852-a1a2-9e86a36a8605 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:35.692839 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-02165151-c7d0-44a9-aaf6-a22429add615 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 19342 microversion: 2.1 time: 0.164100 Feb 19 02:27:35.697179 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 96/194] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:27:35 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 19342 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:27:35.732410 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f32ce473-d666-4852-a1a2-9e86a36a8605 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 27188 microversion: 2.20 time: 0.178425 Feb 19 02:27:35.733919 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 99/195] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:35 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 27188 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 19 02:27:35.780296 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c46c3f8f-b47d-4b65-994d-60877ce327c3 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:35.781080 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c46c3f8f-b47d-4b65-994d-60877ce327c3 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:35.789694 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c46c3f8f-b47d-4b65-994d-60877ce327c3 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:35.790207 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c46c3f8f-b47d-4b65-994d-60877ce327c3 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:35.792120 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c46c3f8f-b47d-4b65-994d-60877ce327c3 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:35.792270 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c46c3f8f-b47d-4b65-994d-60877ce327c3 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:35.817842 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1abc125a-0ea9-4a58-86d4-c2931948a73b tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:35.818617 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1abc125a-0ea9-4a58-86d4-c2931948a73b tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:35.827848 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1abc125a-0ea9-4a58-86d4-c2931948a73b tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:35.828442 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1abc125a-0ea9-4a58-86d4-c2931948a73b tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:35.829356 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1abc125a-0ea9-4a58-86d4-c2931948a73b tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:35.829916 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1abc125a-0ea9-4a58-86d4-c2931948a73b tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:35.885478 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-1abc125a-0ea9-4a58-86d4-c2931948a73b tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] HTTP exception thrown: Instance 7e5b207a-9887-4414-9e31-577bab1ff7da could not be found. Feb 19 02:27:35.886144 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1abc125a-0ea9-4a58-86d4-c2931948a73b tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Returning 404 to user: Instance 7e5b207a-9887-4414-9e31-577bab1ff7da could not be found. {{(pid=98193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:27:35.887107 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1abc125a-0ea9-4a58-86d4-c2931948a73b tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da" status: 404 len: 111 microversion: 2.1 time: 0.073764 Feb 19 02:27:35.887723 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 100/196] 10.222.0.44 () {58 vars in 1229 bytes} [Fri Feb 19 02:27:35 2021] DELETE /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 02:27:35.895904 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-92331345-35e9-44f1-bbae-34cf659180e7 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:35.896565 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-92331345-35e9-44f1-bbae-34cf659180e7 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] [instance: 7e5b207a-9887-4414-9e31-577bab1ff7da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:35.905221 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-92331345-35e9-44f1-bbae-34cf659180e7 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:35.905722 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-92331345-35e9-44f1-bbae-34cf659180e7 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:35.906590 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-92331345-35e9-44f1-bbae-34cf659180e7 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:35.907085 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-92331345-35e9-44f1-bbae-34cf659180e7 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:35.961938 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-92331345-35e9-44f1-bbae-34cf659180e7 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] HTTP exception thrown: Instance 7e5b207a-9887-4414-9e31-577bab1ff7da could not be found. Feb 19 02:27:35.962630 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-92331345-35e9-44f1-bbae-34cf659180e7 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] Returning 404 to user: Instance 7e5b207a-9887-4414-9e31-577bab1ff7da could not be found. {{(pid=98193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:27:35.964092 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-92331345-35e9-44f1-bbae-34cf659180e7 tempest-DeleteServersTestJSON-1635392345 tempest-DeleteServersTestJSON-1635392345-project] 10.222.0.44 "GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da" status: 404 len: 111 microversion: 2.1 time: 0.071465 Feb 19 02:27:35.964694 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 101/197] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:35 2021] GET /compute/v2.1/servers/7e5b207a-9887-4414-9e31-577bab1ff7da => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 02:27:36.008550 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c46c3f8f-b47d-4b65-994d-60877ce327c3 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:36.017934 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c46c3f8f-b47d-4b65-994d-60877ce327c3 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1521 microversion: 2.1 time: 0.242676 Feb 19 02:27:36.018542 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 97/198] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:35 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:36.551458 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c021c2c2-25b4-4ee3-be79-876c8e005ba1 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1706563302", "imageRef": "37a0f9d8-d3f7-417e-bce6-371e41a47c88", "flavorRef": "452", "networks": [{"uuid": "fd54f352-2984-4a61-b9ca-5bbc66d3aa9f"}]}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:36.617945 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-c021c2c2-25b4-4ee3-be79-876c8e005ba1 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] validate_networks() for [('fd54f352-2984-4a61-b9ca-5bbc66d3aa9f', None, None, None)] {{(pid=98193) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 02:27:36.705928 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-6052e359-bf64-4dae-91ad-0e43f2b62c94 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:36.707033 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-6052e359-bf64-4dae-91ad-0e43f2b62c94 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:36.715039 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6052e359-bf64-4dae-91ad-0e43f2b62c94 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:36.715537 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6052e359-bf64-4dae-91ad-0e43f2b62c94 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:36.716372 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6052e359-bf64-4dae-91ad-0e43f2b62c94 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:36.716859 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6052e359-bf64-4dae-91ad-0e43f2b62c94 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:38.258617 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-c021c2c2-25b4-4ee3-be79-876c8e005ba1 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Flavor limits 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 02:27:38.259090 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-c021c2c2-25b4-4ee3-be79-876c8e005ba1 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Image limits 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 02:27:38.259641 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-c021c2c2-25b4-4ee3-be79-876c8e005ba1 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Flavor pref 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 02:27:38.260049 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-c021c2c2-25b4-4ee3-be79-876c8e005ba1 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Image pref 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 02:27:38.260547 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-c021c2c2-25b4-4ee3-be79-876c8e005ba1 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 02:27:38.272922 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c021c2c2-25b4-4ee3-be79-876c8e005ba1 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:38.273429 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c021c2c2-25b4-4ee3-be79-876c8e005ba1 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:38.274339 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c021c2c2-25b4-4ee3-be79-876c8e005ba1 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:38.274923 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c021c2c2-25b4-4ee3-be79-876c8e005ba1 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:38.297625 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-c021c2c2-25b4-4ee3-be79-876c8e005ba1 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Getting quotas for project bf138e653b034c909eb38d6f109c2c4b. Resources: {'ram', 'instances', 'cores'} {{(pid=98193) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:27:38.302143 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-c021c2c2-25b4-4ee3-be79-876c8e005ba1 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Getting quotas for user 50e5a3cbcd6e4b73badbf6ca8db58941 and project bf138e653b034c909eb38d6f109c2c4b. Resources: {'ram', 'instances', 'cores'} {{(pid=98193) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:27:38.313601 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c021c2c2-25b4-4ee3-be79-876c8e005ba1 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Going to run 1 instances... {{(pid=98193) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 02:27:38.316258 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c021c2c2-25b4-4ee3-be79-876c8e005ba1 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: 87ce73f0-276b-4a23-9a93-51e8297cab10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37a0f9d8-d3f7-417e-bce6-371e41a47c88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 02:27:38.369859 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c021c2c2-25b4-4ee3-be79-876c8e005ba1 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.822400 Feb 19 02:27:38.375909 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 102/199] 10.222.0.44 () {60 vars in 1137 bytes} [Fri Feb 19 02:27:36 2021] POST /compute/v2.1/servers => generated 380 bytes in 1824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 02:27:38.375909 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8ba0c055-73c4-4c69-9d5e-811db6f6f1ff tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:38.376957 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8ba0c055-73c4-4c69-9d5e-811db6f6f1ff tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:38.388036 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8ba0c055-73c4-4c69-9d5e-811db6f6f1ff tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:38.389010 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8ba0c055-73c4-4c69-9d5e-811db6f6f1ff tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:38.389881 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8ba0c055-73c4-4c69-9d5e-811db6f6f1ff tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:38.390399 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8ba0c055-73c4-4c69-9d5e-811db6f6f1ff tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:38.684912 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-6052e359-bf64-4dae-91ad-0e43f2b62c94 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 24618 microversion: 2.1 time: 1.982984 Feb 19 02:27:38.685622 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 98/200] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:27:36 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 24618 bytes in 1985 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 19 02:27:38.691129 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5e6bd782-4baa-49e2-9bad-a6617f50b3e9 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:38.691895 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5e6bd782-4baa-49e2-9bad-a6617f50b3e9 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:38.701166 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5e6bd782-4baa-49e2-9bad-a6617f50b3e9 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:38.701676 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5e6bd782-4baa-49e2-9bad-a6617f50b3e9 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:38.702558 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5e6bd782-4baa-49e2-9bad-a6617f50b3e9 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:38.703052 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5e6bd782-4baa-49e2-9bad-a6617f50b3e9 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:38.745023 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8ba0c055-73c4-4c69-9d5e-811db6f6f1ff tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 27782 microversion: 2.20 time: 0.372519 Feb 19 02:27:38.745914 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 103/201] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:38 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 27782 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:27:38.755296 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a6a2120a-a608-4ee9-acab-7ca93e8f3426 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:38.756065 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a6a2120a-a608-4ee9-acab-7ca93e8f3426 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: 87ce73f0-276b-4a23-9a93-51e8297cab10] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:38.816372 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a6a2120a-a608-4ee9-acab-7ca93e8f3426 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:38.816904 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a6a2120a-a608-4ee9-acab-7ca93e8f3426 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:38.819217 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a6a2120a-a608-4ee9-acab-7ca93e8f3426 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:38.819851 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a6a2120a-a608-4ee9-acab-7ca93e8f3426 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:38.970823 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5e6bd782-4baa-49e2-9bad-a6617f50b3e9 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:38.981098 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5e6bd782-4baa-49e2-9bad-a6617f50b3e9 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1521 microversion: 2.1 time: 0.294205 Feb 19 02:27:38.985507 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 99/202] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:38 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:39.042869 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a6a2120a-a608-4ee9-acab-7ca93e8f3426 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:39.052944 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a6a2120a-a608-4ee9-acab-7ca93e8f3426 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10" status: 200 len: 1222 microversion: 2.1 time: 0.301997 Feb 19 02:27:39.054513 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 104/203] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:38 2021] GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10 => generated 1222 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:39.697456 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5dbc0b74-a983-4e08-810b-ab4b5ef6d821 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:39.699451 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5dbc0b74-a983-4e08-810b-ab4b5ef6d821 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:39.709140 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5dbc0b74-a983-4e08-810b-ab4b5ef6d821 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:39.709976 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5dbc0b74-a983-4e08-810b-ab4b5ef6d821 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:39.711120 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5dbc0b74-a983-4e08-810b-ab4b5ef6d821 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:39.711753 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5dbc0b74-a983-4e08-810b-ab4b5ef6d821 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:39.757527 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-da2f70f8-179f-4f03-b3b5-ca5f34c2c0f1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:39.758780 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-da2f70f8-179f-4f03-b3b5-ca5f34c2c0f1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:39.767723 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-da2f70f8-179f-4f03-b3b5-ca5f34c2c0f1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:39.768563 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-da2f70f8-179f-4f03-b3b5-ca5f34c2c0f1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:39.769618 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-da2f70f8-179f-4f03-b3b5-ca5f34c2c0f1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:39.770432 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-da2f70f8-179f-4f03-b3b5-ca5f34c2c0f1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:39.897802 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5dbc0b74-a983-4e08-810b-ab4b5ef6d821 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 25458 microversion: 2.1 time: 0.204810 Feb 19 02:27:39.898839 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 100/204] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:27:39 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 25458 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 19 02:27:39.944582 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-da2f70f8-179f-4f03-b3b5-ca5f34c2c0f1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 28142 microversion: 2.20 time: 0.190818 Feb 19 02:27:39.945807 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 105/205] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:39 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 28142 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:27:40.004505 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-9a1355be-ed8c-46f6-86ad-7a15b897cc36 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:40.005180 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-9a1355be-ed8c-46f6-86ad-7a15b897cc36 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:40.030107 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a1355be-ed8c-46f6-86ad-7a15b897cc36 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:40.030650 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a1355be-ed8c-46f6-86ad-7a15b897cc36 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:40.040354 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a1355be-ed8c-46f6-86ad-7a15b897cc36 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:40.041015 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a1355be-ed8c-46f6-86ad-7a15b897cc36 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:40.252994 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-2e57aa2c-38f7-4767-84e9-f33d31f45b28 tempest-VolumesGetTestJSON-1442133407 tempest-VolumesGetTestJSON-1442133407-project] Action: 'create', calling method: .version_select at 0x7f217d739bf8>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-382851439", "metadata": {"Type": "work"}}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:40.523568 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9a1355be-ed8c-46f6-86ad-7a15b897cc36 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:40.542234 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-9a1355be-ed8c-46f6-86ad-7a15b897cc36 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1521 microversion: 2.1 time: 0.542518 Feb 19 02:27:40.544270 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 106/206] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:39 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1521 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:40.567766 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-567a18eb-3c4a-4ad2-a557-fdae90228220 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:40.568596 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-567a18eb-3c4a-4ad2-a557-fdae90228220 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: 87ce73f0-276b-4a23-9a93-51e8297cab10] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:40.589940 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-567a18eb-3c4a-4ad2-a557-fdae90228220 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:40.590494 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-567a18eb-3c4a-4ad2-a557-fdae90228220 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:40.591354 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-567a18eb-3c4a-4ad2-a557-fdae90228220 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:40.591842 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-567a18eb-3c4a-4ad2-a557-fdae90228220 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:40.868572 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-2e57aa2c-38f7-4767-84e9-f33d31f45b28 tempest-VolumesGetTestJSON-1442133407 tempest-VolumesGetTestJSON-1442133407-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.968185 Feb 19 02:27:40.877302 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 101/207] 10.222.0.44 () {60 vars in 1146 bytes} [Fri Feb 19 02:27:39 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 975 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Feb 19 02:27:40.882872 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-52698d57-4f94-4a81-8d33-c5d3dc9e6adb tempest-VolumesGetTestJSON-1442133407 tempest-VolumesGetTestJSON-1442133407-project] Calling method '.version_select at 0x7f217c328268>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:40.943899 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-567a18eb-3c4a-4ad2-a557-fdae90228220 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:40.963943 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-567a18eb-3c4a-4ad2-a557-fdae90228220 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10" status: 200 len: 1276 microversion: 2.1 time: 0.414244 Feb 19 02:27:40.966012 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 107/208] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:40 2021] GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10 => generated 1276 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:40.980519 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5d91ea74-fce9-4683-a60e-757047584544 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:40.982198 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5d91ea74-fce9-4683-a60e-757047584544 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:41.004820 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5d91ea74-fce9-4683-a60e-757047584544 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:41.005418 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5d91ea74-fce9-4683-a60e-757047584544 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:41.006383 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5d91ea74-fce9-4683-a60e-757047584544 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:41.011777 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5d91ea74-fce9-4683-a60e-757047584544 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:41.131801 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-52698d57-4f94-4a81-8d33-c5d3dc9e6adb tempest-VolumesGetTestJSON-1442133407 tempest-VolumesGetTestJSON-1442133407-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/a2a2eb2d-32f0-43f6-a277-dc0bae73cc09" status: 200 len: 352 microversion: 2.1 time: 0.253042 Feb 19 02:27:41.132458 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 102/209] 10.222.0.44 () {58 vars in 1235 bytes} [Fri Feb 19 02:27:40 2021] GET /compute/v2.1/os-volumes/a2a2eb2d-32f0-43f6-a277-dc0bae73cc09 => generated 352 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:27:41.141646 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-40130958-0099-46a0-942c-331fa8f66db4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:41.143279 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-40130958-0099-46a0-942c-331fa8f66db4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:41.152095 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-40130958-0099-46a0-942c-331fa8f66db4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:41.152822 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-40130958-0099-46a0-942c-331fa8f66db4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:41.153832 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-40130958-0099-46a0-942c-331fa8f66db4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:41.154263 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-40130958-0099-46a0-942c-331fa8f66db4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:41.187821 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5d91ea74-fce9-4683-a60e-757047584544 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 26400 microversion: 2.1 time: 0.219430 Feb 19 02:27:41.188837 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 108/210] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:27:40 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 26400 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:27:41.287734 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-40130958-0099-46a0-942c-331fa8f66db4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 28142 microversion: 2.20 time: 0.153877 Feb 19 02:27:41.291950 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 103/211] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:41 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 28142 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:27:41.562838 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1129aa81-676c-4656-b53b-cd0c8a38e225 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:41.563600 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1129aa81-676c-4656-b53b-cd0c8a38e225 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:41.572195 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1129aa81-676c-4656-b53b-cd0c8a38e225 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:41.572699 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1129aa81-676c-4656-b53b-cd0c8a38e225 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:41.573535 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1129aa81-676c-4656-b53b-cd0c8a38e225 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:41.574385 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1129aa81-676c-4656-b53b-cd0c8a38e225 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:41.984851 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b62949d3-a124-479e-9ce6-59a7c09443b2 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:41.986654 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b62949d3-a124-479e-9ce6-59a7c09443b2 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: 87ce73f0-276b-4a23-9a93-51e8297cab10] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:41.995839 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b62949d3-a124-479e-9ce6-59a7c09443b2 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:41.996328 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b62949d3-a124-479e-9ce6-59a7c09443b2 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:41.997403 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b62949d3-a124-479e-9ce6-59a7c09443b2 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:41.997880 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b62949d3-a124-479e-9ce6-59a7c09443b2 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:42.235359 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-1129aa81-676c-4656-b53b-cd0c8a38e225 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:42.254104 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1129aa81-676c-4656-b53b-cd0c8a38e225 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1521 microversion: 2.1 time: 0.695933 Feb 19 02:27:42.258229 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 109/212] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:41 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1521 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:42.272848 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-114d4575-09fd-4730-be3c-2f95fecac93f tempest-VolumesGetTestJSON-1442133407 tempest-VolumesGetTestJSON-1442133407-project] Calling method '.version_select at 0x7f21816a3ae8>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:42.277069 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b62949d3-a124-479e-9ce6-59a7c09443b2 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:42.292737 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b62949d3-a124-479e-9ce6-59a7c09443b2 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10" status: 200 len: 1318 microversion: 2.1 time: 0.312235 Feb 19 02:27:42.293384 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 104/213] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:41 2021] GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10 => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:27:42.303131 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-2933686a-e8e1-4c4b-96e2-c7e65a97c9df tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:42.303131 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-2933686a-e8e1-4c4b-96e2-c7e65a97c9df tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:42.322124 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2933686a-e8e1-4c4b-96e2-c7e65a97c9df tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:42.329233 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2933686a-e8e1-4c4b-96e2-c7e65a97c9df tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:42.330229 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2933686a-e8e1-4c4b-96e2-c7e65a97c9df tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:42.330763 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2933686a-e8e1-4c4b-96e2-c7e65a97c9df tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:42.445010 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-114d4575-09fd-4730-be3c-2f95fecac93f tempest-VolumesGetTestJSON-1442133407 tempest-VolumesGetTestJSON-1442133407-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/a2a2eb2d-32f0-43f6-a277-dc0bae73cc09" status: 200 len: 353 microversion: 2.1 time: 0.185163 Feb 19 02:27:42.445615 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 110/214] 10.222.0.44 () {58 vars in 1235 bytes} [Fri Feb 19 02:27:42 2021] GET /compute/v2.1/os-volumes/a2a2eb2d-32f0-43f6-a277-dc0bae73cc09 => generated 353 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:27:42.456940 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-88035e1a-f278-4603-ae3b-f25f515bca29 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:42.458003 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-88035e1a-f278-4603-ae3b-f25f515bca29 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:42.468759 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-88035e1a-f278-4603-ae3b-f25f515bca29 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:42.469244 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-88035e1a-f278-4603-ae3b-f25f515bca29 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:42.476806 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-88035e1a-f278-4603-ae3b-f25f515bca29 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:42.478572 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-88035e1a-f278-4603-ae3b-f25f515bca29 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:42.516187 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-2933686a-e8e1-4c4b-96e2-c7e65a97c9df tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 27093 microversion: 2.1 time: 0.220622 Feb 19 02:27:42.517079 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 105/215] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:27:42 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 27093 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:27:42.532337 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ded8e217-27d6-49eb-8cf9-92f01bfdef1e tempest-VolumesGetTestJSON-1442133407 tempest-VolumesGetTestJSON-1442133407-project] Calling method '.version_select at 0x7f217c328d90>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:42.636620 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-88035e1a-f278-4603-ae3b-f25f515bca29 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 28428 microversion: 2.20 time: 0.184020 Feb 19 02:27:42.637659 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 111/216] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:42 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 28428 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:27:42.648774 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ded8e217-27d6-49eb-8cf9-92f01bfdef1e tempest-VolumesGetTestJSON-1442133407 tempest-VolumesGetTestJSON-1442133407-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/a2a2eb2d-32f0-43f6-a277-dc0bae73cc09" status: 200 len: 353 microversion: 2.1 time: 0.127546 Feb 19 02:27:42.649410 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 106/217] 10.222.0.44 () {58 vars in 1235 bytes} [Fri Feb 19 02:27:42 2021] GET /compute/v2.1/os-volumes/a2a2eb2d-32f0-43f6-a277-dc0bae73cc09 => generated 353 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:27:42.671953 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-dbfc9e7c-cb66-48e8-82ed-523f1aa87a5a tempest-VolumesGetTestJSON-1442133407 tempest-VolumesGetTestJSON-1442133407-project] Calling method '.version_select at 0x7f217c3b28c8>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:42.783116 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-dbfc9e7c-cb66-48e8-82ed-523f1aa87a5a tempest-VolumesGetTestJSON-1442133407 tempest-VolumesGetTestJSON-1442133407-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/a2a2eb2d-32f0-43f6-a277-dc0bae73cc09" status: 202 len: 0 microversion: 2.1 time: 0.117455 Feb 19 02:27:42.787318 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 112/218] 10.222.0.44 () {58 vars in 1238 bytes} [Fri Feb 19 02:27:42 2021] DELETE /compute/v2.1/os-volumes/a2a2eb2d-32f0-43f6-a277-dc0bae73cc09 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:27:42.793098 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-62d21fd7-c5fd-4b21-bfcf-ea60c53ec0e5 tempest-VolumesGetTestJSON-1442133407 tempest-VolumesGetTestJSON-1442133407-project] Calling method '.version_select at 0x7f217c328ea0>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:42.900852 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-62d21fd7-c5fd-4b21-bfcf-ea60c53ec0e5 tempest-VolumesGetTestJSON-1442133407 tempest-VolumesGetTestJSON-1442133407-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/a2a2eb2d-32f0-43f6-a277-dc0bae73cc09" status: 200 len: 352 microversion: 2.1 time: 0.111750 Feb 19 02:27:42.901345 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 107/219] 10.222.0.44 () {58 vars in 1235 bytes} [Fri Feb 19 02:27:42 2021] GET /compute/v2.1/os-volumes/a2a2eb2d-32f0-43f6-a277-dc0bae73cc09 => generated 352 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:27:43.278096 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b46f0ee2-5a4b-4b40-859e-530a72726230 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:43.279397 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b46f0ee2-5a4b-4b40-859e-530a72726230 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:43.288699 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b46f0ee2-5a4b-4b40-859e-530a72726230 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:43.289539 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b46f0ee2-5a4b-4b40-859e-530a72726230 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:43.290235 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b46f0ee2-5a4b-4b40-859e-530a72726230 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:43.290752 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b46f0ee2-5a4b-4b40-859e-530a72726230 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:43.311823 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-25096319-be7b-4e62-897e-c8855ffcbdf1 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:43.312894 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-25096319-be7b-4e62-897e-c8855ffcbdf1 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: 87ce73f0-276b-4a23-9a93-51e8297cab10] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:43.324609 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-25096319-be7b-4e62-897e-c8855ffcbdf1 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:43.325550 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-25096319-be7b-4e62-897e-c8855ffcbdf1 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:43.326832 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-25096319-be7b-4e62-897e-c8855ffcbdf1 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:43.327946 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-25096319-be7b-4e62-897e-c8855ffcbdf1 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:43.580858 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-25096319-be7b-4e62-897e-c8855ffcbdf1 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:43.591258 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-25096319-be7b-4e62-897e-c8855ffcbdf1 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10" status: 200 len: 1318 microversion: 2.1 time: 0.284565 Feb 19 02:27:43.601926 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 108/220] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:43 2021] GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10 => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:43.608792 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-223b9533-595a-403e-8564-db03d7fbe36e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:43.609838 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-223b9533-595a-403e-8564-db03d7fbe36e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:43.620560 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-223b9533-595a-403e-8564-db03d7fbe36e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:43.620560 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-223b9533-595a-403e-8564-db03d7fbe36e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:43.620560 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-223b9533-595a-403e-8564-db03d7fbe36e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:43.620861 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-223b9533-595a-403e-8564-db03d7fbe36e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:43.781161 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-223b9533-595a-403e-8564-db03d7fbe36e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 27644 microversion: 2.1 time: 0.177267 Feb 19 02:27:43.782055 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 109/221] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:27:43 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 27644 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:27:43.792603 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-9a8582ac-8e30-488e-bdf5-9a70faa55d16 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:43.793769 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-9a8582ac-8e30-488e-bdf5-9a70faa55d16 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:43.803508 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a8582ac-8e30-488e-bdf5-9a70faa55d16 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:43.803726 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a8582ac-8e30-488e-bdf5-9a70faa55d16 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:43.804605 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a8582ac-8e30-488e-bdf5-9a70faa55d16 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:43.805081 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a8582ac-8e30-488e-bdf5-9a70faa55d16 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:43.811968 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b46f0ee2-5a4b-4b40-859e-530a72726230 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:43.825806 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b46f0ee2-5a4b-4b40-859e-530a72726230 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1501 microversion: 2.1 time: 0.553117 Feb 19 02:27:43.826935 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 113/222] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:43 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1501 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:43.834279 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-d714fcbf-e881-4b1b-88c7-f266a907b892 req-9ddf4ad7-caa3-4e3f-84f2-439c0d6246f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87ce73f0-276b-4a23-9a93-51e8297cab10", "tag": "50be1d4c-77b6-44fb-8fab-6f239ccc76c3"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:43.836280 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:27:43.836280 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:27:43.849314 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-d714fcbf-e881-4b1b-88c7-f266a907b892 req-9ddf4ad7-caa3-4e3f-84f2-439c0d6246f0 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:43.850524 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-d714fcbf-e881-4b1b-88c7-f266a907b892 req-9ddf4ad7-caa3-4e3f-84f2-439c0d6246f0 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:43.873354 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-d714fcbf-e881-4b1b-88c7-f266a907b892 req-9ddf4ad7-caa3-4e3f-84f2-439c0d6246f0 service nova] Creating event network-changed:50be1d4c-77b6-44fb-8fab-6f239ccc76c3 for instance 87ce73f0-276b-4a23-9a93-51e8297cab10 on hv-cinder-77642 Feb 19 02:27:43.879319 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-d714fcbf-e881-4b1b-88c7-f266a907b892 req-9ddf4ad7-caa3-4e3f-84f2-439c0d6246f0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050849 Feb 19 02:27:43.880571 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 114/223] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:27:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:27:43.886320 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-261fed3a-f5dd-470b-95b7-710fffd0a217 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:43.887342 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-261fed3a-f5dd-470b-95b7-710fffd0a217 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:43.898926 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-261fed3a-f5dd-470b-95b7-710fffd0a217 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:43.899523 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-261fed3a-f5dd-470b-95b7-710fffd0a217 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:43.900678 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-261fed3a-f5dd-470b-95b7-710fffd0a217 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:43.901415 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-261fed3a-f5dd-470b-95b7-710fffd0a217 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:43.944728 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-9a8582ac-8e30-488e-bdf5-9a70faa55d16 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 28430 microversion: 2.20 time: 0.157289 Feb 19 02:27:43.945648 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 110/224] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:43 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 28430 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:27:43.970871 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-fee8d6c5-fd1e-4fd8-b18e-3928464edbc6 tempest-VolumesGetTestJSON-1442133407 tempest-VolumesGetTestJSON-1442133407-project] Calling method '.version_select at 0x7f217c26dd90>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:44.065559 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-fee8d6c5-fd1e-4fd8-b18e-3928464edbc6 tempest-VolumesGetTestJSON-1442133407 tempest-VolumesGetTestJSON-1442133407-project] HTTP exception thrown: Volume a2a2eb2d-32f0-43f6-a277-dc0bae73cc09 could not be found. Feb 19 02:27:44.066226 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-fee8d6c5-fd1e-4fd8-b18e-3928464edbc6 tempest-VolumesGetTestJSON-1442133407 tempest-VolumesGetTestJSON-1442133407-project] Returning 404 to user: Volume a2a2eb2d-32f0-43f6-a277-dc0bae73cc09 could not be found. {{(pid=98194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:27:44.067180 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-fee8d6c5-fd1e-4fd8-b18e-3928464edbc6 tempest-VolumesGetTestJSON-1442133407 tempest-VolumesGetTestJSON-1442133407-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/a2a2eb2d-32f0-43f6-a277-dc0bae73cc09" status: 404 len: 109 microversion: 2.1 time: 0.119733 Feb 19 02:27:44.067965 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 111/225] 10.222.0.44 () {58 vars in 1235 bytes} [Fri Feb 19 02:27:43 2021] GET /compute/v2.1/os-volumes/a2a2eb2d-32f0-43f6-a277-dc0bae73cc09 => generated 109 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 02:27:44.324240 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-261fed3a-f5dd-470b-95b7-710fffd0a217 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:44.340087 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-261fed3a-f5dd-470b-95b7-710fffd0a217 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1516 microversion: 2.1 time: 0.457837 Feb 19 02:27:44.341061 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 115/226] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:43 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1516 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:44.609665 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ee2cc9de-90ab-4f44-80aa-7c9cb9096e0a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:44.610795 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ee2cc9de-90ab-4f44-80aa-7c9cb9096e0a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: 87ce73f0-276b-4a23-9a93-51e8297cab10] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:44.621942 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ee2cc9de-90ab-4f44-80aa-7c9cb9096e0a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:44.622477 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ee2cc9de-90ab-4f44-80aa-7c9cb9096e0a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:44.623357 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ee2cc9de-90ab-4f44-80aa-7c9cb9096e0a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:44.624015 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ee2cc9de-90ab-4f44-80aa-7c9cb9096e0a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:44.795323 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-07c2582a-b295-4d29-ad94-9723750977c7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:44.796583 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-07c2582a-b295-4d29-ad94-9723750977c7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:44.820347 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-07c2582a-b295-4d29-ad94-9723750977c7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:44.820873 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-07c2582a-b295-4d29-ad94-9723750977c7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:44.822001 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-07c2582a-b295-4d29-ad94-9723750977c7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:44.824654 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-07c2582a-b295-4d29-ad94-9723750977c7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:45.014325 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-07c2582a-b295-4d29-ad94-9723750977c7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 27897 microversion: 2.1 time: 0.224298 Feb 19 02:27:45.016463 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 116/227] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:27:44 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 27897 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:27:45.023590 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1512de50-18df-4a78-8f64-3302c5f6674b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:45.027779 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1512de50-18df-4a78-8f64-3302c5f6674b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:45.049105 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1512de50-18df-4a78-8f64-3302c5f6674b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:45.049561 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1512de50-18df-4a78-8f64-3302c5f6674b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:45.051487 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1512de50-18df-4a78-8f64-3302c5f6674b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:45.052158 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1512de50-18df-4a78-8f64-3302c5f6674b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:45.202656 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1512de50-18df-4a78-8f64-3302c5f6674b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 28597 microversion: 2.20 time: 0.184537 Feb 19 02:27:45.207315 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 117/228] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:45 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 28597 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:27:45.263042 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ee2cc9de-90ab-4f44-80aa-7c9cb9096e0a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:45.275069 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ee2cc9de-90ab-4f44-80aa-7c9cb9096e0a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10" status: 200 len: 1318 microversion: 2.1 time: 0.670083 Feb 19 02:27:45.276140 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 112/229] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:44 2021] GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10 => generated 1318 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:46.029334 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-cc6b3d42-4690-40e0-83de-c0bc46672aad tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:46.031323 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-cc6b3d42-4690-40e0-83de-c0bc46672aad tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:46.049727 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cc6b3d42-4690-40e0-83de-c0bc46672aad tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:46.050255 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cc6b3d42-4690-40e0-83de-c0bc46672aad tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:46.051823 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cc6b3d42-4690-40e0-83de-c0bc46672aad tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:46.052144 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cc6b3d42-4690-40e0-83de-c0bc46672aad tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:46.196325 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-cc6b3d42-4690-40e0-83de-c0bc46672aad tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 28192 microversion: 2.1 time: 0.172194 Feb 19 02:27:46.197954 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 118/230] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:27:46 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 28192 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:27:46.217126 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-363d5909-560a-4f89-a172-ee6f17a04892 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:46.218192 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-363d5909-560a-4f89-a172-ee6f17a04892 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:46.231555 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-363d5909-560a-4f89-a172-ee6f17a04892 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:46.232063 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-363d5909-560a-4f89-a172-ee6f17a04892 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:46.232924 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-363d5909-560a-4f89-a172-ee6f17a04892 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:46.233414 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-363d5909-560a-4f89-a172-ee6f17a04892 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:46.294473 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ae89341c-1af4-4904-b417-0220d4dfef8d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:46.295244 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ae89341c-1af4-4904-b417-0220d4dfef8d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: 87ce73f0-276b-4a23-9a93-51e8297cab10] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:46.305472 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ae89341c-1af4-4904-b417-0220d4dfef8d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:46.305980 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ae89341c-1af4-4904-b417-0220d4dfef8d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:46.311995 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ae89341c-1af4-4904-b417-0220d4dfef8d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:46.313101 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ae89341c-1af4-4904-b417-0220d4dfef8d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:46.375534 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-363d5909-560a-4f89-a172-ee6f17a04892 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 28597 microversion: 2.20 time: 0.163937 Feb 19 02:27:46.376522 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 113/231] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:46 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 28597 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:27:46.386518 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f2f25897-3c0d-4e14-81d3-2ef66317ae4c tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:46.387747 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f2f25897-3c0d-4e14-81d3-2ef66317ae4c tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:46.417430 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f2f25897-3c0d-4e14-81d3-2ef66317ae4c tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:46.417943 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f2f25897-3c0d-4e14-81d3-2ef66317ae4c tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:46.423858 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f2f25897-3c0d-4e14-81d3-2ef66317ae4c tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:46.425814 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f2f25897-3c0d-4e14-81d3-2ef66317ae4c tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:46.540635 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.objects.instance [None req-f2f25897-3c0d-4e14-81d3-2ef66317ae4c tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lazy-loading 'flavor' on Instance uuid c0a55cfa-c2c0-48e5-b519-53c9b68c38cd {{(pid=98194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 02:27:46.811264 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f2f25897-3c0d-4e14-81d3-2ef66317ae4c tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "POST /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd/action" status: 200 len: 32 microversion: 2.1 time: 0.431168 Feb 19 02:27:46.812101 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 114/232] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:27:46 2021] POST /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd/action => generated 32 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:27:46.840758 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-eb51b5ba-e730-4e1d-805d-2f9a05a2f793 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:46.841663 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-eb51b5ba-e730-4e1d-805d-2f9a05a2f793 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:46.844797 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ae89341c-1af4-4904-b417-0220d4dfef8d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:46.853093 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-eb51b5ba-e730-4e1d-805d-2f9a05a2f793 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:46.854242 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-eb51b5ba-e730-4e1d-805d-2f9a05a2f793 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:46.855255 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-eb51b5ba-e730-4e1d-805d-2f9a05a2f793 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:46.855882 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-eb51b5ba-e730-4e1d-805d-2f9a05a2f793 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:46.866261 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ae89341c-1af4-4904-b417-0220d4dfef8d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10" status: 200 len: 1318 microversion: 2.1 time: 0.576702 Feb 19 02:27:46.867124 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 119/233] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:46 2021] GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10 => generated 1318 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:47.213555 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-471e0229-728f-4b4b-8cfa-2e26a6ff7674 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:47.214510 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-471e0229-728f-4b4b-8cfa-2e26a6ff7674 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:47.229675 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-471e0229-728f-4b4b-8cfa-2e26a6ff7674 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:47.230620 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-471e0229-728f-4b4b-8cfa-2e26a6ff7674 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:47.232446 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-471e0229-728f-4b4b-8cfa-2e26a6ff7674 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:47.233615 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-471e0229-728f-4b4b-8cfa-2e26a6ff7674 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:47.259501 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-eb51b5ba-e730-4e1d-805d-2f9a05a2f793 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:47.279900 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-eb51b5ba-e730-4e1d-805d-2f9a05a2f793 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1522 microversion: 2.1 time: 0.449686 Feb 19 02:27:47.282337 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 115/234] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:46 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1522 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:27:47.386749 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-471e0229-728f-4b4b-8cfa-2e26a6ff7674 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 28192 microversion: 2.1 time: 0.180799 Feb 19 02:27:47.387620 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 120/235] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:27:47 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 28192 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:27:47.393342 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-3c1ca668-49f5-4dad-8693-7d7ef9b2dd3b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:47.394508 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-3c1ca668-49f5-4dad-8693-7d7ef9b2dd3b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:47.404771 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3c1ca668-49f5-4dad-8693-7d7ef9b2dd3b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:47.405454 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3c1ca668-49f5-4dad-8693-7d7ef9b2dd3b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:47.407017 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3c1ca668-49f5-4dad-8693-7d7ef9b2dd3b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:47.407646 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3c1ca668-49f5-4dad-8693-7d7ef9b2dd3b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:47.550208 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-3c1ca668-49f5-4dad-8693-7d7ef9b2dd3b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 28597 microversion: 2.20 time: 0.165493 Feb 19 02:27:47.551742 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 116/236] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:47 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 28597 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 19 02:27:47.885783 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-784dd97f-b501-47ff-b2c7-f009cb67e11d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:47.886711 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-784dd97f-b501-47ff-b2c7-f009cb67e11d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: 87ce73f0-276b-4a23-9a93-51e8297cab10] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:47.896711 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-784dd97f-b501-47ff-b2c7-f009cb67e11d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:47.897583 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-784dd97f-b501-47ff-b2c7-f009cb67e11d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:47.899044 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-784dd97f-b501-47ff-b2c7-f009cb67e11d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:47.899919 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-784dd97f-b501-47ff-b2c7-f009cb67e11d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:48.250390 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-784dd97f-b501-47ff-b2c7-f009cb67e11d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:48.261042 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-784dd97f-b501-47ff-b2c7-f009cb67e11d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10" status: 200 len: 1318 microversion: 2.1 time: 0.380887 Feb 19 02:27:48.262294 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 121/237] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:47 2021] GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10 => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:48.301800 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8102c677-0999-40d6-aa4c-278e73ee2732 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:48.302819 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8102c677-0999-40d6-aa4c-278e73ee2732 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:48.321814 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-08eb92f0-2b76-4e2b-bbf9-055c61156d2e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-225011616", "imageRef": "37a0f9d8-d3f7-417e-bce6-371e41a47c88", "flavorRef": "452", "networks": [{"uuid": "1bc79e11-006d-4d02-867b-ccd717770aea"}]}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:48.334994 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8102c677-0999-40d6-aa4c-278e73ee2732 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:48.335553 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8102c677-0999-40d6-aa4c-278e73ee2732 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:48.336451 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8102c677-0999-40d6-aa4c-278e73ee2732 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:48.336942 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8102c677-0999-40d6-aa4c-278e73ee2732 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:48.414274 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-08eb92f0-2b76-4e2b-bbf9-055c61156d2e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] validate_networks() for [('1bc79e11-006d-4d02-867b-ccd717770aea', None, None, None)] {{(pid=98193) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 02:27:48.621198 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8102c677-0999-40d6-aa4c-278e73ee2732 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:48.630833 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8102c677-0999-40d6-aa4c-278e73ee2732 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1522 microversion: 2.1 time: 0.333550 Feb 19 02:27:48.631715 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 117/238] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:48 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:48.637602 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c0e40059-a23e-4d16-bbca-521b37ece092 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:48.638978 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c0e40059-a23e-4d16-bbca-521b37ece092 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:48.647013 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c0e40059-a23e-4d16-bbca-521b37ece092 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:48.647516 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c0e40059-a23e-4d16-bbca-521b37ece092 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:48.648376 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c0e40059-a23e-4d16-bbca-521b37ece092 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:48.648869 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c0e40059-a23e-4d16-bbca-521b37ece092 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:48.779793 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c0e40059-a23e-4d16-bbca-521b37ece092 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 28317 microversion: 2.1 time: 0.146244 Feb 19 02:27:48.780830 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 118/239] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:27:48 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 28317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:27:48.786803 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-6cb5d9d0-7fe5-4977-ba98-e9fd5ddca32e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:48.787942 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-6cb5d9d0-7fe5-4977-ba98-e9fd5ddca32e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:48.809651 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6cb5d9d0-7fe5-4977-ba98-e9fd5ddca32e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:48.813220 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6cb5d9d0-7fe5-4977-ba98-e9fd5ddca32e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:48.817364 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6cb5d9d0-7fe5-4977-ba98-e9fd5ddca32e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:48.818588 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6cb5d9d0-7fe5-4977-ba98-e9fd5ddca32e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:48.956110 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-6cb5d9d0-7fe5-4977-ba98-e9fd5ddca32e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 28597 microversion: 2.20 time: 0.172176 Feb 19 02:27:48.957271 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 119/240] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:48 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 28597 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:27:48.968741 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-435ed107-244c-419f-9c1a-7d8303b225ac req-e52eac12-d5ba-4d4c-8dbe-f34b68a53812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87ce73f0-276b-4a23-9a93-51e8297cab10", "name": "network-vif-plugged", "status": "completed", "tag": "50be1d4c-77b6-44fb-8fab-6f239ccc76c3"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:48.977995 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:27:48.977995 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:27:48.992721 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-435ed107-244c-419f-9c1a-7d8303b225ac req-e52eac12-d5ba-4d4c-8dbe-f34b68a53812 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:49.003290 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-435ed107-244c-419f-9c1a-7d8303b225ac req-e52eac12-d5ba-4d4c-8dbe-f34b68a53812 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:49.033563 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-435ed107-244c-419f-9c1a-7d8303b225ac req-e52eac12-d5ba-4d4c-8dbe-f34b68a53812 service nova] Creating event network-vif-plugged:50be1d4c-77b6-44fb-8fab-6f239ccc76c3 for instance 87ce73f0-276b-4a23-9a93-51e8297cab10 on hv-cinder-77642 Feb 19 02:27:49.039575 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-435ed107-244c-419f-9c1a-7d8303b225ac req-e52eac12-d5ba-4d4c-8dbe-f34b68a53812 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077588 Feb 19 02:27:49.040511 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 120/241] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:27:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:27:49.190715 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-08eb92f0-2b76-4e2b-bbf9-055c61156d2e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Flavor limits 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 02:27:49.191440 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-08eb92f0-2b76-4e2b-bbf9-055c61156d2e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Image limits 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 02:27:49.192112 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-08eb92f0-2b76-4e2b-bbf9-055c61156d2e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Flavor pref 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 02:27:49.193111 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-08eb92f0-2b76-4e2b-bbf9-055c61156d2e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Image pref 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 02:27:49.193700 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-08eb92f0-2b76-4e2b-bbf9-055c61156d2e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 02:27:49.206588 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-08eb92f0-2b76-4e2b-bbf9-055c61156d2e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:49.207185 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-08eb92f0-2b76-4e2b-bbf9-055c61156d2e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:49.208966 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-08eb92f0-2b76-4e2b-bbf9-055c61156d2e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:49.209584 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-08eb92f0-2b76-4e2b-bbf9-055c61156d2e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:49.233118 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-08eb92f0-2b76-4e2b-bbf9-055c61156d2e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Getting quotas for project 2b706884b7904a598558fe41d1d16d26. Resources: {'ram', 'instances', 'cores'} {{(pid=98193) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:27:49.237709 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-08eb92f0-2b76-4e2b-bbf9-055c61156d2e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Getting quotas for user d5457e8bd9454f33a5f2c47221c8f018 and project 2b706884b7904a598558fe41d1d16d26. Resources: {'ram', 'instances', 'cores'} {{(pid=98193) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:27:49.251024 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-08eb92f0-2b76-4e2b-bbf9-055c61156d2e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Going to run 1 instances... {{(pid=98193) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 02:27:49.253637 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-08eb92f0-2b76-4e2b-bbf9-055c61156d2e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: a8f51745-ea4b-4e85-9ba3-ada6a215cb7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37a0f9d8-d3f7-417e-bce6-371e41a47c88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 02:27:49.281616 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8884dad1-00e9-4947-bd03-3866ea27c72e tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:49.282404 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8884dad1-00e9-4947-bd03-3866ea27c72e tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: 87ce73f0-276b-4a23-9a93-51e8297cab10] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:49.303302 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8884dad1-00e9-4947-bd03-3866ea27c72e tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:49.303846 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8884dad1-00e9-4947-bd03-3866ea27c72e tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:49.305369 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8884dad1-00e9-4947-bd03-3866ea27c72e tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:49.305868 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8884dad1-00e9-4947-bd03-3866ea27c72e tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:49.376060 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-08eb92f0-2b76-4e2b-bbf9-055c61156d2e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.057891 Feb 19 02:27:49.376755 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 122/242] 10.222.0.44 () {60 vars in 1137 bytes} [Fri Feb 19 02:27:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 1060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 02:27:49.398213 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-6f1f389c-c235-42d5-83d1-2894ea22f12c tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:49.399711 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-6f1f389c-c235-42d5-83d1-2894ea22f12c tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: a8f51745-ea4b-4e85-9ba3-ada6a215cb7b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:49.533310 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-6f1f389c-c235-42d5-83d1-2894ea22f12c tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5457e8bd9454f33a5f2c47221c8f018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b706884b7904a598558fe41d1d16d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:49.571437 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-6f1f389c-c235-42d5-83d1-2894ea22f12c tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b" status: 200 len: 1213 microversion: 2.1 time: 0.186180 Feb 19 02:27:49.575376 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 123/243] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:49 2021] GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b => generated 1213 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:49.649720 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c96fd27f-ec6f-4bd7-b3a7-838799920e99 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:49.651399 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c96fd27f-ec6f-4bd7-b3a7-838799920e99 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:49.661242 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8884dad1-00e9-4947-bd03-3866ea27c72e tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:49.673371 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8884dad1-00e9-4947-bd03-3866ea27c72e tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10" status: 200 len: 1318 microversion: 2.1 time: 0.396611 Feb 19 02:27:49.674102 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 121/244] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:49 2021] GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10 => generated 1318 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:27:49.677692 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c96fd27f-ec6f-4bd7-b3a7-838799920e99 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:49.678200 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c96fd27f-ec6f-4bd7-b3a7-838799920e99 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:49.679089 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c96fd27f-ec6f-4bd7-b3a7-838799920e99 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:49.679583 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c96fd27f-ec6f-4bd7-b3a7-838799920e99 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:49.794395 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-dcc8dc9e-dd02-4bed-a904-fef5557718bb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:49.795435 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-dcc8dc9e-dd02-4bed-a904-fef5557718bb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:49.842093 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dcc8dc9e-dd02-4bed-a904-fef5557718bb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:49.847427 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dcc8dc9e-dd02-4bed-a904-fef5557718bb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:49.848503 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dcc8dc9e-dd02-4bed-a904-fef5557718bb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:49.849286 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dcc8dc9e-dd02-4bed-a904-fef5557718bb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:50.081368 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-dcc8dc9e-dd02-4bed-a904-fef5557718bb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 28481 microversion: 2.1 time: 0.290512 Feb 19 02:27:50.081718 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c96fd27f-ec6f-4bd7-b3a7-838799920e99 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:50.085547 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 122/245] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:27:49 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 28481 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 19 02:27:50.089718 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7618b7ea-77d0-4a70-8ef4-736b297bd189 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:50.091472 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7618b7ea-77d0-4a70-8ef4-736b297bd189 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:50.095200 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c96fd27f-ec6f-4bd7-b3a7-838799920e99 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1522 microversion: 2.1 time: 0.449714 Feb 19 02:27:50.095873 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 124/246] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:49 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1522 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:50.109201 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7618b7ea-77d0-4a70-8ef4-736b297bd189 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:50.110010 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7618b7ea-77d0-4a70-8ef4-736b297bd189 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:50.111615 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7618b7ea-77d0-4a70-8ef4-736b297bd189 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:50.112252 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7618b7ea-77d0-4a70-8ef4-736b297bd189 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:50.398074 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7618b7ea-77d0-4a70-8ef4-736b297bd189 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 29464 microversion: 2.20 time: 0.313826 Feb 19 02:27:50.399300 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 123/247] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:50 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 29464 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:27:50.593295 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-9a4bce4a-f1af-4a4d-a272-08db85aee4af tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:50.593960 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-9a4bce4a-f1af-4a4d-a272-08db85aee4af tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: a8f51745-ea4b-4e85-9ba3-ada6a215cb7b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:50.601798 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a4bce4a-f1af-4a4d-a272-08db85aee4af tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:50.602301 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a4bce4a-f1af-4a4d-a272-08db85aee4af tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:50.603165 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a4bce4a-f1af-4a4d-a272-08db85aee4af tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:50.604185 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a4bce4a-f1af-4a4d-a272-08db85aee4af tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:50.691771 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-69a30a68-8035-4064-9c8d-259b97c3ad73 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:50.692534 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-69a30a68-8035-4064-9c8d-259b97c3ad73 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: 87ce73f0-276b-4a23-9a93-51e8297cab10] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:50.701436 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-69a30a68-8035-4064-9c8d-259b97c3ad73 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:50.701949 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-69a30a68-8035-4064-9c8d-259b97c3ad73 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:50.702826 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-69a30a68-8035-4064-9c8d-259b97c3ad73 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:50.703322 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-69a30a68-8035-4064-9c8d-259b97c3ad73 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:50.734713 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9a4bce4a-f1af-4a4d-a272-08db85aee4af tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5457e8bd9454f33a5f2c47221c8f018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b706884b7904a598558fe41d1d16d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:50.745294 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-9a4bce4a-f1af-4a4d-a272-08db85aee4af tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b" status: 200 len: 1265 microversion: 2.1 time: 0.155152 Feb 19 02:27:50.746181 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 125/248] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:50 2021] GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:50.995827 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-69a30a68-8035-4064-9c8d-259b97c3ad73 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:51.011913 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-69a30a68-8035-4064-9c8d-259b97c3ad73 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10" status: 200 len: 1318 microversion: 2.1 time: 0.323714 Feb 19 02:27:51.012543 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 124/249] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:50 2021] GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10 => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:27:51.094213 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4171a8fb-0ae6-4170-bcbb-9b8cd4085af3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:51.095508 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-4171a8fb-0ae6-4170-bcbb-9b8cd4085af3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:51.116840 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f843b57d-9922-45ae-881e-72cb5878cf40 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:51.117051 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f843b57d-9922-45ae-881e-72cb5878cf40 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:51.140401 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4171a8fb-0ae6-4170-bcbb-9b8cd4085af3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:51.140401 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4171a8fb-0ae6-4170-bcbb-9b8cd4085af3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:51.140401 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4171a8fb-0ae6-4170-bcbb-9b8cd4085af3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:51.140401 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4171a8fb-0ae6-4170-bcbb-9b8cd4085af3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:51.165155 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f843b57d-9922-45ae-881e-72cb5878cf40 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:51.168792 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f843b57d-9922-45ae-881e-72cb5878cf40 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:51.169906 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f843b57d-9922-45ae-881e-72cb5878cf40 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:51.171876 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f843b57d-9922-45ae-881e-72cb5878cf40 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:51.317854 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-4171a8fb-0ae6-4170-bcbb-9b8cd4085af3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 28648 microversion: 2.1 time: 0.227480 Feb 19 02:27:51.318909 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 126/250] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:27:51 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 28648 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:27:51.413287 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-2fa5bde4-1c51-4277-9e28-3b168969d477 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:51.415155 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-2fa5bde4-1c51-4277-9e28-3b168969d477 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:51.456108 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2fa5bde4-1c51-4277-9e28-3b168969d477 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:51.457322 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2fa5bde4-1c51-4277-9e28-3b168969d477 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:51.459816 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2fa5bde4-1c51-4277-9e28-3b168969d477 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:51.464380 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2fa5bde4-1c51-4277-9e28-3b168969d477 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:51.520042 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f843b57d-9922-45ae-881e-72cb5878cf40 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:51.531412 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f843b57d-9922-45ae-881e-72cb5878cf40 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1522 microversion: 2.1 time: 0.419495 Feb 19 02:27:51.532477 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 125/251] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:51 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1522 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:51.664849 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-2fa5bde4-1c51-4277-9e28-3b168969d477 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 30721 microversion: 2.20 time: 0.257042 Feb 19 02:27:51.671868 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 127/252] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:51 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 30721 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:27:51.764952 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b080726b-4241-4cb3-bb78-3a34bba8b5fb tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:51.765747 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b080726b-4241-4cb3-bb78-3a34bba8b5fb tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: a8f51745-ea4b-4e85-9ba3-ada6a215cb7b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:51.775068 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b080726b-4241-4cb3-bb78-3a34bba8b5fb tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:51.775772 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b080726b-4241-4cb3-bb78-3a34bba8b5fb tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:51.776881 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b080726b-4241-4cb3-bb78-3a34bba8b5fb tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:51.777861 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b080726b-4241-4cb3-bb78-3a34bba8b5fb tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:51.907152 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b080726b-4241-4cb3-bb78-3a34bba8b5fb tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5457e8bd9454f33a5f2c47221c8f018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b706884b7904a598558fe41d1d16d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:51.918530 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b080726b-4241-4cb3-bb78-3a34bba8b5fb tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b" status: 200 len: 1271 microversion: 2.1 time: 0.158244 Feb 19 02:27:51.919745 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 126/253] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:51 2021] GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b => generated 1271 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:52.033625 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-85a60b6e-0463-4fba-b602-89c5414f671f tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:52.034735 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-85a60b6e-0463-4fba-b602-89c5414f671f tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: 87ce73f0-276b-4a23-9a93-51e8297cab10] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:52.045429 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-85a60b6e-0463-4fba-b602-89c5414f671f tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:52.046427 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-85a60b6e-0463-4fba-b602-89c5414f671f tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:52.047489 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-85a60b6e-0463-4fba-b602-89c5414f671f tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:52.048189 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-85a60b6e-0463-4fba-b602-89c5414f671f tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:52.332152 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8c470b5e-5415-440f-9256-a0db48241c0b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:52.333431 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8c470b5e-5415-440f-9256-a0db48241c0b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:52.342943 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8c470b5e-5415-440f-9256-a0db48241c0b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:52.343635 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8c470b5e-5415-440f-9256-a0db48241c0b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:52.344732 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8c470b5e-5415-440f-9256-a0db48241c0b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:52.345682 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8c470b5e-5415-440f-9256-a0db48241c0b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:52.498716 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-85a60b6e-0463-4fba-b602-89c5414f671f tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:52.508402 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-85a60b6e-0463-4fba-b602-89c5414f671f tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10" status: 200 len: 1505 microversion: 2.1 time: 0.480590 Feb 19 02:27:52.509145 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 128/254] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:52 2021] GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10 => generated 1505 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:52.549915 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b0e1b278-88ec-4463-88ed-e7eface60169 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:52.550872 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b0e1b278-88ec-4463-88ed-e7eface60169 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:52.559731 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b0e1b278-88ec-4463-88ed-e7eface60169 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:52.560244 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b0e1b278-88ec-4463-88ed-e7eface60169 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:52.561203 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b0e1b278-88ec-4463-88ed-e7eface60169 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:52.561696 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b0e1b278-88ec-4463-88ed-e7eface60169 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:52.798583 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b0e1b278-88ec-4463-88ed-e7eface60169 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:52.809894 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b0e1b278-88ec-4463-88ed-e7eface60169 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1522 microversion: 2.1 time: 0.264402 Feb 19 02:27:52.810585 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 129/255] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:52 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:27:52.816446 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-3d78bd4b-76e4-4acb-9544-cf227d3270f5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:52.817480 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-3d78bd4b-76e4-4acb-9544-cf227d3270f5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:52.829690 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3d78bd4b-76e4-4acb-9544-cf227d3270f5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:52.830276 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3d78bd4b-76e4-4acb-9544-cf227d3270f5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:52.831222 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3d78bd4b-76e4-4acb-9544-cf227d3270f5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:52.831794 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3d78bd4b-76e4-4acb-9544-cf227d3270f5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:54.971264 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8c470b5e-5415-440f-9256-a0db48241c0b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 28648 microversion: 2.1 time: 2.642862 Feb 19 02:27:54.972185 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 127/256] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:27:52 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 28648 bytes in 2645 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 19 02:27:54.978167 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1a95802e-a061-4be2-8447-aa2d2318d9dd tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:54.979040 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1a95802e-a061-4be2-8447-aa2d2318d9dd tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: a8f51745-ea4b-4e85-9ba3-ada6a215cb7b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:54.988200 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1a95802e-a061-4be2-8447-aa2d2318d9dd tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:54.988758 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1a95802e-a061-4be2-8447-aa2d2318d9dd tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:54.989749 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1a95802e-a061-4be2-8447-aa2d2318d9dd tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:54.990417 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1a95802e-a061-4be2-8447-aa2d2318d9dd tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:55.012068 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-3d78bd4b-76e4-4acb-9544-cf227d3270f5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 32994 microversion: 2.20 time: 2.199948 Feb 19 02:27:55.014105 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 130/257] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:52 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 32994 bytes in 2202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:27:55.019797 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b113db1b-183d-478a-a05f-a3cd3ff0ec71 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:55.020791 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b113db1b-183d-478a-a05f-a3cd3ff0ec71 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:55.030838 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b113db1b-183d-478a-a05f-a3cd3ff0ec71 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:55.031521 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b113db1b-183d-478a-a05f-a3cd3ff0ec71 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:55.032514 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b113db1b-183d-478a-a05f-a3cd3ff0ec71 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:55.033123 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b113db1b-183d-478a-a05f-a3cd3ff0ec71 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:55.258858 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-1a95802e-a061-4be2-8447-aa2d2318d9dd tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5457e8bd9454f33a5f2c47221c8f018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b706884b7904a598558fe41d1d16d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:55.269391 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1a95802e-a061-4be2-8447-aa2d2318d9dd tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b" status: 200 len: 1313 microversion: 2.1 time: 0.295959 Feb 19 02:27:55.270192 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 128/258] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:54 2021] GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:55.544443 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b113db1b-183d-478a-a05f-a3cd3ff0ec71 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:55.554241 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b113db1b-183d-478a-a05f-a3cd3ff0ec71 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1522 microversion: 2.1 time: 0.539684 Feb 19 02:27:55.555030 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 131/259] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:55 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1522 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:55.984659 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f0ed2152-2372-4a49-83c1-f87a4e5797e0 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:55.986191 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f0ed2152-2372-4a49-83c1-f87a4e5797e0 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:55.996401 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f0ed2152-2372-4a49-83c1-f87a4e5797e0 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:55.996913 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f0ed2152-2372-4a49-83c1-f87a4e5797e0 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:55.998003 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f0ed2152-2372-4a49-83c1-f87a4e5797e0 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:55.998658 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f0ed2152-2372-4a49-83c1-f87a4e5797e0 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:56.026709 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-47a8f159-a55f-4290-9bfe-c567fe8c8f34 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:56.028103 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-47a8f159-a55f-4290-9bfe-c567fe8c8f34 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:56.038612 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-47a8f159-a55f-4290-9bfe-c567fe8c8f34 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:56.039373 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-47a8f159-a55f-4290-9bfe-c567fe8c8f34 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:56.040417 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-47a8f159-a55f-4290-9bfe-c567fe8c8f34 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:56.041698 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-47a8f159-a55f-4290-9bfe-c567fe8c8f34 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:56.128309 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f0ed2152-2372-4a49-83c1-f87a4e5797e0 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 28648 microversion: 2.1 time: 0.147150 Feb 19 02:27:56.129019 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 129/260] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:27:55 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 28648 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:27:56.197921 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-47a8f159-a55f-4290-9bfe-c567fe8c8f34 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 33533 microversion: 2.20 time: 0.175588 Feb 19 02:27:56.199425 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 132/261] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:56 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 33533 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:27:56.287779 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1b87e8ca-4cfb-465d-b56e-7e0a53119174 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:56.288528 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1b87e8ca-4cfb-465d-b56e-7e0a53119174 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: a8f51745-ea4b-4e85-9ba3-ada6a215cb7b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:56.309182 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1b87e8ca-4cfb-465d-b56e-7e0a53119174 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:56.309819 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1b87e8ca-4cfb-465d-b56e-7e0a53119174 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:56.311956 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1b87e8ca-4cfb-465d-b56e-7e0a53119174 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:56.312692 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1b87e8ca-4cfb-465d-b56e-7e0a53119174 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:56.399525 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-911e5b22-dc53-4cc3-9479-89232fbcecb3 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba4eb44c-81df-4c27-9119-8a550add4c59"}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:56.402085 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-911e5b22-dc53-4cc3-9479-89232fbcecb3 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: 87ce73f0-276b-4a23-9a93-51e8297cab10] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:56.411461 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-911e5b22-dc53-4cc3-9479-89232fbcecb3 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:56.412104 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-911e5b22-dc53-4cc3-9479-89232fbcecb3 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:56.412965 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-911e5b22-dc53-4cc3-9479-89232fbcecb3 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:56.413453 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-911e5b22-dc53-4cc3-9479-89232fbcecb3 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:56.663611 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-1b87e8ca-4cfb-465d-b56e-7e0a53119174 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5457e8bd9454f33a5f2c47221c8f018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b706884b7904a598558fe41d1d16d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:56.694951 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1b87e8ca-4cfb-465d-b56e-7e0a53119174 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b" status: 200 len: 1313 microversion: 2.1 time: 0.411362 Feb 19 02:27:56.702510 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 130/262] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:56 2021] GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b => generated 1313 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:56.702510 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4b991677-86dd-460c-9aae-565c9223dc3f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:56.707013 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-4b991677-86dd-460c-9aae-565c9223dc3f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:56.717278 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4b991677-86dd-460c-9aae-565c9223dc3f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:56.720218 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4b991677-86dd-460c-9aae-565c9223dc3f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:56.722499 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4b991677-86dd-460c-9aae-565c9223dc3f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:56.723347 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4b991677-86dd-460c-9aae-565c9223dc3f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:56.901284 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-911e5b22-dc53-4cc3-9479-89232fbcecb3 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "POST /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.506737 Feb 19 02:27:56.902796 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 133/263] 10.222.0.44 () {60 vars in 1313 bytes} [Fri Feb 19 02:27:56 2021] POST /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10/os-volume_attachments => generated 194 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:27:56.910547 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-5fd4e51e-7c17-407a-96be-54b9e005e25e req-31175be4-86db-450c-9aec-3120f56c9bea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8f51745-ea4b-4e85-9ba3-ada6a215cb7b", "tag": "04018fdb-62b7-43ab-886c-080bcd1b112f"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:56.924944 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:27:56.924944 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:27:56.959078 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-5fd4e51e-7c17-407a-96be-54b9e005e25e req-31175be4-86db-450c-9aec-3120f56c9bea service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:56.960036 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-5fd4e51e-7c17-407a-96be-54b9e005e25e req-31175be4-86db-450c-9aec-3120f56c9bea service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:56.977694 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-4b991677-86dd-460c-9aae-565c9223dc3f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:56.988710 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-4b991677-86dd-460c-9aae-565c9223dc3f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1522 microversion: 2.1 time: 0.291683 Feb 19 02:27:56.989359 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 131/264] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:56 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:56.994755 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-5fd4e51e-7c17-407a-96be-54b9e005e25e req-31175be4-86db-450c-9aec-3120f56c9bea service nova] Creating event network-changed:04018fdb-62b7-43ab-886c-080bcd1b112f for instance a8f51745-ea4b-4e85-9ba3-ada6a215cb7b on hv-cinder-77642 Feb 19 02:27:57.001987 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-5fd4e51e-7c17-407a-96be-54b9e005e25e req-31175be4-86db-450c-9aec-3120f56c9bea service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096960 Feb 19 02:27:57.003045 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 134/265] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:27:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:27:57.141515 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-162d0ad3-9a7a-4582-88a4-25b32e11a8b8 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:57.142621 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-162d0ad3-9a7a-4582-88a4-25b32e11a8b8 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:57.151296 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-162d0ad3-9a7a-4582-88a4-25b32e11a8b8 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:57.151957 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-162d0ad3-9a7a-4582-88a4-25b32e11a8b8 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:57.154192 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-162d0ad3-9a7a-4582-88a4-25b32e11a8b8 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:57.156434 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-162d0ad3-9a7a-4582-88a4-25b32e11a8b8 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:57.213318 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a89cbf5a-2123-4d97-8a21-a269723deb10 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:57.214882 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a89cbf5a-2123-4d97-8a21-a269723deb10 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:57.232129 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a89cbf5a-2123-4d97-8a21-a269723deb10 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:57.235051 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a89cbf5a-2123-4d97-8a21-a269723deb10 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:57.236056 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a89cbf5a-2123-4d97-8a21-a269723deb10 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:57.237121 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a89cbf5a-2123-4d97-8a21-a269723deb10 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:57.278825 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-162d0ad3-9a7a-4582-88a4-25b32e11a8b8 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 28648 microversion: 2.1 time: 0.141256 Feb 19 02:27:57.279552 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 132/266] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:27:57 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 28648 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:27:57.398515 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a89cbf5a-2123-4d97-8a21-a269723deb10 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 34414 microversion: 2.20 time: 0.190457 Feb 19 02:27:57.399664 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 135/267] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:57 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 34414 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:27:57.716006 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5c30953e-7219-4e35-b7d8-6e4772259ad2 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:57.717213 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5c30953e-7219-4e35-b7d8-6e4772259ad2 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: a8f51745-ea4b-4e85-9ba3-ada6a215cb7b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:57.734568 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5c30953e-7219-4e35-b7d8-6e4772259ad2 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:57.736013 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5c30953e-7219-4e35-b7d8-6e4772259ad2 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:57.736519 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5c30953e-7219-4e35-b7d8-6e4772259ad2 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:57.737119 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5c30953e-7219-4e35-b7d8-6e4772259ad2 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:58.008596 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5c30953e-7219-4e35-b7d8-6e4772259ad2 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5457e8bd9454f33a5f2c47221c8f018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b706884b7904a598558fe41d1d16d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:58.014168 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f8123ceb-afa7-4202-bef3-06ae30be1af2 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:58.014957 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f8123ceb-afa7-4202-bef3-06ae30be1af2 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:58.021559 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5c30953e-7219-4e35-b7d8-6e4772259ad2 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b" status: 200 len: 1313 microversion: 2.1 time: 0.310850 Feb 19 02:27:58.022218 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 133/268] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:57 2021] GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:58.026878 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f8123ceb-afa7-4202-bef3-06ae30be1af2 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:58.027488 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f8123ceb-afa7-4202-bef3-06ae30be1af2 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:58.028428 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f8123ceb-afa7-4202-bef3-06ae30be1af2 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:58.028977 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f8123ceb-afa7-4202-bef3-06ae30be1af2 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:58.291714 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-871ec46e-4755-4ccc-9384-d7bde1406a70 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:58.293003 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-871ec46e-4755-4ccc-9384-d7bde1406a70 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:58.302064 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-871ec46e-4755-4ccc-9384-d7bde1406a70 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:58.302064 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-871ec46e-4755-4ccc-9384-d7bde1406a70 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:58.303075 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-871ec46e-4755-4ccc-9384-d7bde1406a70 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:58.303948 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-871ec46e-4755-4ccc-9384-d7bde1406a70 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:58.438199 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-871ec46e-4755-4ccc-9384-d7bde1406a70 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 28648 microversion: 2.1 time: 0.150628 Feb 19 02:27:58.439128 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 134/269] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:27:58 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 28648 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 19 02:27:58.444722 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-3125d9d3-ccca-4553-afeb-91b89714915a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:58.445871 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-3125d9d3-ccca-4553-afeb-91b89714915a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:58.455408 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3125d9d3-ccca-4553-afeb-91b89714915a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:58.455916 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3125d9d3-ccca-4553-afeb-91b89714915a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:58.456778 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3125d9d3-ccca-4553-afeb-91b89714915a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:58.457271 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3125d9d3-ccca-4553-afeb-91b89714915a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:58.521435 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f8123ceb-afa7-4202-bef3-06ae30be1af2 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:58.531647 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f8123ceb-afa7-4202-bef3-06ae30be1af2 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1522 microversion: 2.1 time: 0.523937 Feb 19 02:27:58.558756 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 136/270] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:58 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1522 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:58.625096 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-3125d9d3-ccca-4553-afeb-91b89714915a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 35195 microversion: 2.20 time: 0.184325 Feb 19 02:27:58.629489 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 135/271] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:58 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 35195 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:27:59.040244 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-977c16cd-68e4-46bc-aa80-99142ec9e5b4 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:59.041011 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-977c16cd-68e4-46bc-aa80-99142ec9e5b4 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: a8f51745-ea4b-4e85-9ba3-ada6a215cb7b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:59.050498 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-977c16cd-68e4-46bc-aa80-99142ec9e5b4 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:59.051284 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-977c16cd-68e4-46bc-aa80-99142ec9e5b4 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:59.052311 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-977c16cd-68e4-46bc-aa80-99142ec9e5b4 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:59.052981 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-977c16cd-68e4-46bc-aa80-99142ec9e5b4 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:59.326273 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-977c16cd-68e4-46bc-aa80-99142ec9e5b4 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5457e8bd9454f33a5f2c47221c8f018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b706884b7904a598558fe41d1d16d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:59.337178 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-977c16cd-68e4-46bc-aa80-99142ec9e5b4 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b" status: 200 len: 1313 microversion: 2.1 time: 0.300857 Feb 19 02:27:59.338474 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 137/272] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:59 2021] GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b => generated 1313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:27:59.452951 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a4b64995-1d27-4edd-b953-32bbce0f0932 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:59.455094 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a4b64995-1d27-4edd-b953-32bbce0f0932 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:59.489046 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a4b64995-1d27-4edd-b953-32bbce0f0932 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:59.489562 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a4b64995-1d27-4edd-b953-32bbce0f0932 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:59.490442 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a4b64995-1d27-4edd-b953-32bbce0f0932 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:59.490940 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a4b64995-1d27-4edd-b953-32bbce0f0932 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:59.549681 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-cc25a34e-e277-41df-8002-ce3002cb6bf2 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:27:59.550329 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-cc25a34e-e277-41df-8002-ce3002cb6bf2 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:59.560107 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cc25a34e-e277-41df-8002-ce3002cb6bf2 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:59.560666 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cc25a34e-e277-41df-8002-ce3002cb6bf2 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:59.567025 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cc25a34e-e277-41df-8002-ce3002cb6bf2 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:59.567763 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cc25a34e-e277-41df-8002-ce3002cb6bf2 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:59.622441 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a4b64995-1d27-4edd-b953-32bbce0f0932 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 28648 microversion: 2.1 time: 0.174246 Feb 19 02:27:59.625558 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 136/273] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:27:59 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 28648 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:27:59.641943 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5e05e4eb-0e24-4f3a-89ac-6faef25b2efd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:27:59.644270 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5e05e4eb-0e24-4f3a-89ac-6faef25b2efd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:27:59.658537 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5e05e4eb-0e24-4f3a-89ac-6faef25b2efd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:59.659297 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5e05e4eb-0e24-4f3a-89ac-6faef25b2efd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:59.660309 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5e05e4eb-0e24-4f3a-89ac-6faef25b2efd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:27:59.661133 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5e05e4eb-0e24-4f3a-89ac-6faef25b2efd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:27:59.813141 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5e05e4eb-0e24-4f3a-89ac-6faef25b2efd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 36433 microversion: 2.20 time: 0.178548 Feb 19 02:27:59.814236 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 137/274] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:27:59 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 36433 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:27:59.825958 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-cc25a34e-e277-41df-8002-ce3002cb6bf2 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:27:59.836063 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-cc25a34e-e277-41df-8002-ce3002cb6bf2 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1522 microversion: 2.1 time: 0.290654 Feb 19 02:27:59.836715 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 138/275] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:27:59 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:28:00.357235 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-840636f7-1d46-4525-a97c-a5b397a91ccd tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:00.358283 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-840636f7-1d46-4525-a97c-a5b397a91ccd tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: a8f51745-ea4b-4e85-9ba3-ada6a215cb7b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:00.377756 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-840636f7-1d46-4525-a97c-a5b397a91ccd tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:00.378269 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-840636f7-1d46-4525-a97c-a5b397a91ccd tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:00.379139 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-840636f7-1d46-4525-a97c-a5b397a91ccd tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:00.379624 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-840636f7-1d46-4525-a97c-a5b397a91ccd tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:00.610128 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-840636f7-1d46-4525-a97c-a5b397a91ccd tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5457e8bd9454f33a5f2c47221c8f018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b706884b7904a598558fe41d1d16d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:00.619729 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-840636f7-1d46-4525-a97c-a5b397a91ccd tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b" status: 200 len: 1313 microversion: 2.1 time: 0.266970 Feb 19 02:28:00.620364 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 138/276] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:00 2021] GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:00.637079 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-06d7d31c-6301-4c8f-b9ea-a4f6a469404e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:00.638258 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-06d7d31c-6301-4c8f-b9ea-a4f6a469404e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:00.646303 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-06d7d31c-6301-4c8f-b9ea-a4f6a469404e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:00.646856 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-06d7d31c-6301-4c8f-b9ea-a4f6a469404e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:00.647694 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-06d7d31c-6301-4c8f-b9ea-a4f6a469404e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:00.648179 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-06d7d31c-6301-4c8f-b9ea-a4f6a469404e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:00.770812 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-06d7d31c-6301-4c8f-b9ea-a4f6a469404e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 28648 microversion: 2.1 time: 0.138055 Feb 19 02:28:00.771546 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 139/277] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:28:00 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 28648 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:28:00.827359 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-9e81173e-a198-473b-b9b1-c70f716570b6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:00.828407 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-9e81173e-a198-473b-b9b1-c70f716570b6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:00.836196 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9e81173e-a198-473b-b9b1-c70f716570b6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:00.836699 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9e81173e-a198-473b-b9b1-c70f716570b6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:00.837536 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9e81173e-a198-473b-b9b1-c70f716570b6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:00.838031 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9e81173e-a198-473b-b9b1-c70f716570b6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:00.867436 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-cd391204-8688-45e7-8b18-47007fa5530e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:00.868231 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-cd391204-8688-45e7-8b18-47007fa5530e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:00.877603 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cd391204-8688-45e7-8b18-47007fa5530e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:00.878144 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cd391204-8688-45e7-8b18-47007fa5530e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:00.879055 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cd391204-8688-45e7-8b18-47007fa5530e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:00.879545 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cd391204-8688-45e7-8b18-47007fa5530e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:00.970501 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-9e81173e-a198-473b-b9b1-c70f716570b6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 37277 microversion: 2.20 time: 0.147560 Feb 19 02:28:00.971488 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 139/278] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:28:00 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 37277 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:28:01.088586 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-cd391204-8688-45e7-8b18-47007fa5530e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:01.097374 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-cd391204-8688-45e7-8b18-47007fa5530e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1522 microversion: 2.1 time: 0.244045 Feb 19 02:28:01.097998 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 140/279] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:00 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:28:01.641143 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d4cff2b1-4b46-494a-bdd2-6892c167ad22 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:01.642466 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d4cff2b1-4b46-494a-bdd2-6892c167ad22 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: a8f51745-ea4b-4e85-9ba3-ada6a215cb7b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:01.651948 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d4cff2b1-4b46-494a-bdd2-6892c167ad22 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:01.652499 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d4cff2b1-4b46-494a-bdd2-6892c167ad22 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:01.653359 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d4cff2b1-4b46-494a-bdd2-6892c167ad22 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:01.653856 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d4cff2b1-4b46-494a-bdd2-6892c167ad22 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:01.783851 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-0cdc1fd5-7fcd-4aa3-a1db-f3793fbf7abc tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:01.785177 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-0cdc1fd5-7fcd-4aa3-a1db-f3793fbf7abc tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:01.794345 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0cdc1fd5-7fcd-4aa3-a1db-f3793fbf7abc tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:01.794987 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0cdc1fd5-7fcd-4aa3-a1db-f3793fbf7abc tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:01.795880 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0cdc1fd5-7fcd-4aa3-a1db-f3793fbf7abc tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:01.796443 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0cdc1fd5-7fcd-4aa3-a1db-f3793fbf7abc tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:01.883528 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-d4cff2b1-4b46-494a-bdd2-6892c167ad22 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5457e8bd9454f33a5f2c47221c8f018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b706884b7904a598558fe41d1d16d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:01.892706 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d4cff2b1-4b46-494a-bdd2-6892c167ad22 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b" status: 200 len: 1313 microversion: 2.1 time: 0.258144 Feb 19 02:28:01.893343 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 140/280] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:01 2021] GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:28:01.947525 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-0cdc1fd5-7fcd-4aa3-a1db-f3793fbf7abc tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 29348 microversion: 2.1 time: 0.167942 Feb 19 02:28:01.948441 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 141/281] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:28:01 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 29348 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:28:01.983732 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c6d18bb2-8343-424c-a0b7-1ad74cdc9000 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:01.984998 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c6d18bb2-8343-424c-a0b7-1ad74cdc9000 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:01.993109 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c6d18bb2-8343-424c-a0b7-1ad74cdc9000 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:01.993611 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c6d18bb2-8343-424c-a0b7-1ad74cdc9000 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:01.995025 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c6d18bb2-8343-424c-a0b7-1ad74cdc9000 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:01.995510 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c6d18bb2-8343-424c-a0b7-1ad74cdc9000 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:02.117748 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-dd3e999e-92aa-4354-8045-04d3ebd0306f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:02.118607 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-dd3e999e-92aa-4354-8045-04d3ebd0306f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:02.124137 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c6d18bb2-8343-424c-a0b7-1ad74cdc9000 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 38007 microversion: 2.20 time: 0.144519 Feb 19 02:28:02.125785 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 141/282] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:28:01 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 38007 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:28:02.128034 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dd3e999e-92aa-4354-8045-04d3ebd0306f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:02.128547 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dd3e999e-92aa-4354-8045-04d3ebd0306f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:02.129406 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dd3e999e-92aa-4354-8045-04d3ebd0306f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:02.129913 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dd3e999e-92aa-4354-8045-04d3ebd0306f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:02.285774 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-c9045139-b85f-4519-bd05-843924fe39e4 req-522d1fe0-7766-4a63-94e0-41479fd6c0be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8f51745-ea4b-4e85-9ba3-ada6a215cb7b", "name": "network-vif-plugged", "status": "completed", "tag": "04018fdb-62b7-43ab-886c-080bcd1b112f"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:02.287595 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:28:02.287595 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:28:02.302335 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-c9045139-b85f-4519-bd05-843924fe39e4 req-522d1fe0-7766-4a63-94e0-41479fd6c0be service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:02.302335 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-c9045139-b85f-4519-bd05-843924fe39e4 req-522d1fe0-7766-4a63-94e0-41479fd6c0be service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:02.321647 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-c9045139-b85f-4519-bd05-843924fe39e4 req-522d1fe0-7766-4a63-94e0-41479fd6c0be service nova] Creating event network-vif-plugged:04018fdb-62b7-43ab-886c-080bcd1b112f for instance a8f51745-ea4b-4e85-9ba3-ada6a215cb7b on hv-cinder-77642 Feb 19 02:28:02.327980 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-c9045139-b85f-4519-bd05-843924fe39e4 req-522d1fe0-7766-4a63-94e0-41479fd6c0be service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046636 Feb 19 02:28:02.328708 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 142/283] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:28:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:28:02.625721 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-dd3e999e-92aa-4354-8045-04d3ebd0306f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:02.634683 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-dd3e999e-92aa-4354-8045-04d3ebd0306f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1522 microversion: 2.1 time: 0.521515 Feb 19 02:28:02.635332 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 142/284] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:02 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1522 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:28:02.912099 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f11ffad1-95cb-4f00-bf91-d7a6a1aa8637 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:02.912839 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f11ffad1-95cb-4f00-bf91-d7a6a1aa8637 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: a8f51745-ea4b-4e85-9ba3-ada6a215cb7b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:02.924416 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f11ffad1-95cb-4f00-bf91-d7a6a1aa8637 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:02.925239 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f11ffad1-95cb-4f00-bf91-d7a6a1aa8637 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:02.926873 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f11ffad1-95cb-4f00-bf91-d7a6a1aa8637 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:02.928034 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f11ffad1-95cb-4f00-bf91-d7a6a1aa8637 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:02.960654 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-47034140-e23f-46be-9770-0b764c066b0f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:02.962442 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-47034140-e23f-46be-9770-0b764c066b0f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:02.972854 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-47034140-e23f-46be-9770-0b764c066b0f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:02.973366 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-47034140-e23f-46be-9770-0b764c066b0f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:02.974396 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-47034140-e23f-46be-9770-0b764c066b0f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:02.975123 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-47034140-e23f-46be-9770-0b764c066b0f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:03.136609 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-47034140-e23f-46be-9770-0b764c066b0f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 30625 microversion: 2.1 time: 0.180939 Feb 19 02:28:03.138284 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 143/285] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:28:02 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 30625 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:28:03.143430 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-6c45566f-2814-447d-8b34-69cf08fb8a4e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:03.144569 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-6c45566f-2814-447d-8b34-69cf08fb8a4e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:03.154134 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6c45566f-2814-447d-8b34-69cf08fb8a4e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:03.154670 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6c45566f-2814-447d-8b34-69cf08fb8a4e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:03.155527 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6c45566f-2814-447d-8b34-69cf08fb8a4e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:03.156020 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6c45566f-2814-447d-8b34-69cf08fb8a4e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:03.165864 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f11ffad1-95cb-4f00-bf91-d7a6a1aa8637 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5457e8bd9454f33a5f2c47221c8f018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b706884b7904a598558fe41d1d16d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:03.175341 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f11ffad1-95cb-4f00-bf91-d7a6a1aa8637 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b" status: 200 len: 1313 microversion: 2.1 time: 0.267848 Feb 19 02:28:03.176140 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 143/286] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:02 2021] GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:03.294044 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-6c45566f-2814-447d-8b34-69cf08fb8a4e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 38088 microversion: 2.20 time: 0.154929 Feb 19 02:28:03.295200 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 144/287] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:28:03 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 38088 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:28:03.654027 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-214bcc8d-9a78-409c-9859-62293076fb2e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:03.654880 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-214bcc8d-9a78-409c-9859-62293076fb2e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:03.663305 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-214bcc8d-9a78-409c-9859-62293076fb2e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:03.663818 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-214bcc8d-9a78-409c-9859-62293076fb2e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:03.664713 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-214bcc8d-9a78-409c-9859-62293076fb2e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:03.665210 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-214bcc8d-9a78-409c-9859-62293076fb2e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:03.890392 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-214bcc8d-9a78-409c-9859-62293076fb2e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:03.899841 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-214bcc8d-9a78-409c-9859-62293076fb2e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1522 microversion: 2.1 time: 0.250685 Feb 19 02:28:03.900743 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 144/288] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:03 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:04.159713 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-337d3c34-fd86-4ec8-8d60-59bfb9c6f98f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:04.162620 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-337d3c34-fd86-4ec8-8d60-59bfb9c6f98f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:04.174665 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-337d3c34-fd86-4ec8-8d60-59bfb9c6f98f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:04.175350 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-337d3c34-fd86-4ec8-8d60-59bfb9c6f98f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:04.176380 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-337d3c34-fd86-4ec8-8d60-59bfb9c6f98f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:04.176845 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-337d3c34-fd86-4ec8-8d60-59bfb9c6f98f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:04.193722 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7b79185e-de76-48e2-8a27-6d8f19f25b8b tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:04.194571 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7b79185e-de76-48e2-8a27-6d8f19f25b8b tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: a8f51745-ea4b-4e85-9ba3-ada6a215cb7b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:04.210753 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7b79185e-de76-48e2-8a27-6d8f19f25b8b tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:04.211258 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7b79185e-de76-48e2-8a27-6d8f19f25b8b tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:04.212314 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7b79185e-de76-48e2-8a27-6d8f19f25b8b tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:04.215179 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7b79185e-de76-48e2-8a27-6d8f19f25b8b tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:04.419517 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-337d3c34-fd86-4ec8-8d60-59bfb9c6f98f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 31504 microversion: 2.1 time: 0.272571 Feb 19 02:28:04.420960 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 145/289] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:28:04 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 31504 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:28:04.429863 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-96d8e818-b678-4349-839e-8333baf36b44 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:04.431704 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-96d8e818-b678-4349-839e-8333baf36b44 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:04.441839 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-96d8e818-b678-4349-839e-8333baf36b44 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:04.442501 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-96d8e818-b678-4349-839e-8333baf36b44 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:04.443619 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-96d8e818-b678-4349-839e-8333baf36b44 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:04.444227 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-96d8e818-b678-4349-839e-8333baf36b44 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:04.544254 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7b79185e-de76-48e2-8a27-6d8f19f25b8b tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5457e8bd9454f33a5f2c47221c8f018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b706884b7904a598558fe41d1d16d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:04.556765 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7b79185e-de76-48e2-8a27-6d8f19f25b8b tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b" status: 200 len: 1313 microversion: 2.1 time: 0.366822 Feb 19 02:28:04.557483 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 145/290] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:04 2021] GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b => generated 1313 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:04.586242 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-96d8e818-b678-4349-839e-8333baf36b44 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 200 len: 38229 microversion: 2.20 time: 0.163283 Feb 19 02:28:04.592199 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 146/291] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:28:04 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 38229 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:28:04.599917 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c08d575e-c592-4ad3-ae90-9c0a0bdbb29b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:04.600461 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c08d575e-c592-4ad3-ae90-9c0a0bdbb29b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:04.609097 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c08d575e-c592-4ad3-ae90-9c0a0bdbb29b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:04.609599 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c08d575e-c592-4ad3-ae90-9c0a0bdbb29b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:04.610457 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c08d575e-c592-4ad3-ae90-9c0a0bdbb29b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:04.610939 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c08d575e-c592-4ad3-ae90-9c0a0bdbb29b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:04.680847 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c08d575e-c592-4ad3-ae90-9c0a0bdbb29b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/ips" status: 200 len: 152 microversion: 2.20 time: 0.086791 Feb 19 02:28:04.688008 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 146/292] 10.222.0.44 () {60 vars in 1279 bytes} [Fri Feb 19 02:28:04 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/ips => generated 152 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:28:04.947823 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7ae9e16d-b858-4b76-8893-e77f8dea6301 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:04.948703 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7ae9e16d-b858-4b76-8893-e77f8dea6301 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:04.972874 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7ae9e16d-b858-4b76-8893-e77f8dea6301 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:04.980018 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7ae9e16d-b858-4b76-8893-e77f8dea6301 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:04.982338 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7ae9e16d-b858-4b76-8893-e77f8dea6301 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:04.982968 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7ae9e16d-b858-4b76-8893-e77f8dea6301 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:05.015360 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7ca7b5fb-c0be-495e-86a5-2ebec63185f8 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba4eb44c-81df-4c27-9119-8a550add4c59"}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:05.016888 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7ca7b5fb-c0be-495e-86a5-2ebec63185f8 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: 87ce73f0-276b-4a23-9a93-51e8297cab10] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:05.033638 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7ca7b5fb-c0be-495e-86a5-2ebec63185f8 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:05.034403 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7ca7b5fb-c0be-495e-86a5-2ebec63185f8 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:05.035960 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7ca7b5fb-c0be-495e-86a5-2ebec63185f8 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:05.036792 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7ca7b5fb-c0be-495e-86a5-2ebec63185f8 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:05.300428 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-7ca7b5fb-c0be-495e-86a5-2ebec63185f8 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] HTTP exception thrown: Invalid volume: volume ba4eb44c-81df-4c27-9119-8a550add4c59 is already attached to instances: 87ce73f0-276b-4a23-9a93-51e8297cab10 Feb 19 02:28:05.301119 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7ca7b5fb-c0be-495e-86a5-2ebec63185f8 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Returning 400 to user: Invalid volume: volume ba4eb44c-81df-4c27-9119-8a550add4c59 is already attached to instances: 87ce73f0-276b-4a23-9a93-51e8297cab10 {{(pid=98194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:28:05.302050 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7ca7b5fb-c0be-495e-86a5-2ebec63185f8 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "POST /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.291261 Feb 19 02:28:05.302728 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 147/293] 10.222.0.44 () {60 vars in 1313 bytes} [Fri Feb 19 02:28:05 2021] POST /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10/os-volume_attachments => generated 174 bytes in 293 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 19 02:28:05.344917 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7ae9e16d-b858-4b76-8893-e77f8dea6301 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:05.354677 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7ae9e16d-b858-4b76-8893-e77f8dea6301 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1522 microversion: 2.1 time: 0.437666 Feb 19 02:28:05.366426 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 147/294] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:04 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1522 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:05.422312 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f1646c7f-6ad6-4510-a03d-4358aad31dce tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:05.422899 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f1646c7f-6ad6-4510-a03d-4358aad31dce tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: 87ce73f0-276b-4a23-9a93-51e8297cab10] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:05.431724 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f1646c7f-6ad6-4510-a03d-4358aad31dce tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:05.432237 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f1646c7f-6ad6-4510-a03d-4358aad31dce tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:05.432755 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-79188299-61bf-472a-9bfa-41e55d5db7d9 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:05.433086 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f1646c7f-6ad6-4510-a03d-4358aad31dce tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:05.433582 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f1646c7f-6ad6-4510-a03d-4358aad31dce tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:05.433804 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-79188299-61bf-472a-9bfa-41e55d5db7d9 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:05.441953 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-79188299-61bf-472a-9bfa-41e55d5db7d9 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:05.442670 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-79188299-61bf-472a-9bfa-41e55d5db7d9 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:05.443529 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-79188299-61bf-472a-9bfa-41e55d5db7d9 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:05.444222 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-79188299-61bf-472a-9bfa-41e55d5db7d9 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:05.581801 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-79188299-61bf-472a-9bfa-41e55d5db7d9 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 32738 microversion: 2.1 time: 0.152565 Feb 19 02:28:05.582559 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 148/295] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:28:05 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 32738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:28:05.589619 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-06f5c5aa-9fe7-4b73-b4c1-cdbc56c4db49 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:05.590554 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-06f5c5aa-9fe7-4b73-b4c1-cdbc56c4db49 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: a8f51745-ea4b-4e85-9ba3-ada6a215cb7b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:05.600155 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-06f5c5aa-9fe7-4b73-b4c1-cdbc56c4db49 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:05.601155 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-06f5c5aa-9fe7-4b73-b4c1-cdbc56c4db49 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:05.602161 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-06f5c5aa-9fe7-4b73-b4c1-cdbc56c4db49 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:05.602887 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-06f5c5aa-9fe7-4b73-b4c1-cdbc56c4db49 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:05.619928 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.objects.instance [None req-f1646c7f-6ad6-4510-a03d-4358aad31dce tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lazy-loading 'services' on Instance uuid 87ce73f0-276b-4a23-9a93-51e8297cab10 {{(pid=98194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 02:28:05.796290 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f1646c7f-6ad6-4510-a03d-4358aad31dce tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "DELETE /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10/os-volume_attachments/ba4eb44c-81df-4c27-9119-8a550add4c59" status: 202 len: 0 microversion: 2.1 time: 0.377769 Feb 19 02:28:05.797110 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 148/296] 10.222.0.44 () {58 vars in 1406 bytes} [Fri Feb 19 02:28:05 2021] DELETE /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10/os-volume_attachments/ba4eb44c-81df-4c27-9119-8a550add4c59 => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:28:05.847863 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-06f5c5aa-9fe7-4b73-b4c1-cdbc56c4db49 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5457e8bd9454f33a5f2c47221c8f018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b706884b7904a598558fe41d1d16d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:05.858333 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-06f5c5aa-9fe7-4b73-b4c1-cdbc56c4db49 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b" status: 200 len: 1496 microversion: 2.1 time: 0.273981 Feb 19 02:28:05.859272 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 149/297] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:05 2021] GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b => generated 1496 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:06.373924 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d1c68452-0fab-4d8b-921f-bffc1d5406c2 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:06.374772 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d1c68452-0fab-4d8b-921f-bffc1d5406c2 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:06.382970 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d1c68452-0fab-4d8b-921f-bffc1d5406c2 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:06.383472 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d1c68452-0fab-4d8b-921f-bffc1d5406c2 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:06.384841 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d1c68452-0fab-4d8b-921f-bffc1d5406c2 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:06.385335 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d1c68452-0fab-4d8b-921f-bffc1d5406c2 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:06.593658 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ec2a2e85-e371-4b82-8998-8db02ad5957b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:06.594788 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ec2a2e85-e371-4b82-8998-8db02ad5957b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:06.604637 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ec2a2e85-e371-4b82-8998-8db02ad5957b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:06.605158 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ec2a2e85-e371-4b82-8998-8db02ad5957b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:06.606160 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ec2a2e85-e371-4b82-8998-8db02ad5957b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:06.606707 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ec2a2e85-e371-4b82-8998-8db02ad5957b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:06.644769 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-d1c68452-0fab-4d8b-921f-bffc1d5406c2 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:06.657561 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d1c68452-0fab-4d8b-921f-bffc1d5406c2 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1522 microversion: 2.1 time: 0.287943 Feb 19 02:28:06.677355 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 149/298] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:06 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:06.722130 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-68f6a67f-1dcc-4958-b158-363697ac565a tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:06.722749 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-68f6a67f-1dcc-4958-b158-363697ac565a tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: a8f51745-ea4b-4e85-9ba3-ada6a215cb7b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:06.730841 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-68f6a67f-1dcc-4958-b158-363697ac565a tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:06.731354 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-68f6a67f-1dcc-4958-b158-363697ac565a tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:06.732326 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-68f6a67f-1dcc-4958-b158-363697ac565a tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:06.732769 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-68f6a67f-1dcc-4958-b158-363697ac565a tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:06.759226 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ec2a2e85-e371-4b82-8998-8db02ad5957b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 33436 microversion: 2.1 time: 0.169316 Feb 19 02:28:06.760798 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 150/299] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:28:06 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 33436 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:28:06.798889 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-68f6a67f-1dcc-4958-b158-363697ac565a tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: a8f51745-ea4b-4e85-9ba3-ada6a215cb7b] Going to try to terminate instance {{(pid=98194) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 02:28:06.928318 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-68f6a67f-1dcc-4958-b158-363697ac565a tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b" status: 204 len: 0 microversion: 2.1 time: 0.209715 Feb 19 02:28:06.929784 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 150/300] 10.222.0.44 () {58 vars in 1229 bytes} [Fri Feb 19 02:28:06 2021] DELETE /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 19 02:28:06.939645 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c8384b1a-ed9b-461c-8d37-c71801228a1c tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:06.940426 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c8384b1a-ed9b-461c-8d37-c71801228a1c tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: a8f51745-ea4b-4e85-9ba3-ada6a215cb7b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:06.953515 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c8384b1a-ed9b-461c-8d37-c71801228a1c tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:06.954888 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c8384b1a-ed9b-461c-8d37-c71801228a1c tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:06.955887 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c8384b1a-ed9b-461c-8d37-c71801228a1c tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:06.956487 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c8384b1a-ed9b-461c-8d37-c71801228a1c tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:07.254023 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c8384b1a-ed9b-461c-8d37-c71801228a1c tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5457e8bd9454f33a5f2c47221c8f018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b706884b7904a598558fe41d1d16d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:07.263677 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c8384b1a-ed9b-461c-8d37-c71801228a1c tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b" status: 200 len: 1502 microversion: 2.1 time: 0.328542 Feb 19 02:28:07.264661 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 151/301] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:06 2021] GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b => generated 1502 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:07.264771 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-eecd3d14-ec51-4dcb-a18e-adfc1dd427bb tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1109835208", "imageRef": "37a0f9d8-d3f7-417e-bce6-371e41a47c88", "flavorRef": "452", "networks": [{"uuid": "fd54f352-2984-4a61-b9ca-5bbc66d3aa9f"}]}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:07.349839 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-eecd3d14-ec51-4dcb-a18e-adfc1dd427bb tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] validate_networks() for [('fd54f352-2984-4a61-b9ca-5bbc66d3aa9f', None, None, None)] {{(pid=98194) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 02:28:07.515402 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f242c18b-cbb3-4862-b070-ecf8d4d9357a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:07.516003 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f242c18b-cbb3-4862-b070-ecf8d4d9357a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:07.524392 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f242c18b-cbb3-4862-b070-ecf8d4d9357a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:07.524913 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f242c18b-cbb3-4862-b070-ecf8d4d9357a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:07.525775 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f242c18b-cbb3-4862-b070-ecf8d4d9357a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:07.526295 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f242c18b-cbb3-4862-b070-ecf8d4d9357a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:07.600280 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.objects.instance [None req-f242c18b-cbb3-4862-b070-ecf8d4d9357a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lazy-loading 'flavor' on Instance uuid 5265f377-f5b9-4f2c-a6e8-3bf64fb08733 {{(pid=98193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 02:28:07.953981 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-eecd3d14-ec51-4dcb-a18e-adfc1dd427bb tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Flavor limits 0:0:0 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 02:28:07.954490 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-eecd3d14-ec51-4dcb-a18e-adfc1dd427bb tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Image limits 0:0:0 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 02:28:07.955038 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-eecd3d14-ec51-4dcb-a18e-adfc1dd427bb tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Flavor pref 0:0:0 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 02:28:07.955508 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-eecd3d14-ec51-4dcb-a18e-adfc1dd427bb tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Image pref 0:0:0 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 02:28:07.956005 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-eecd3d14-ec51-4dcb-a18e-adfc1dd427bb tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 02:28:07.965412 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-eecd3d14-ec51-4dcb-a18e-adfc1dd427bb tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:07.966155 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-eecd3d14-ec51-4dcb-a18e-adfc1dd427bb tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:07.967110 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-eecd3d14-ec51-4dcb-a18e-adfc1dd427bb tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:07.967762 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-eecd3d14-ec51-4dcb-a18e-adfc1dd427bb tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:07.988869 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-eecd3d14-ec51-4dcb-a18e-adfc1dd427bb tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Getting quotas for project bf138e653b034c909eb38d6f109c2c4b. Resources: {'ram', 'instances', 'cores'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:28:07.993459 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-eecd3d14-ec51-4dcb-a18e-adfc1dd427bb tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Getting quotas for user 50e5a3cbcd6e4b73badbf6ca8db58941 and project bf138e653b034c909eb38d6f109c2c4b. Resources: {'ram', 'instances', 'cores'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:28:08.005473 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f242c18b-cbb3-4862-b070-ecf8d4d9357a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 202 len: 0 microversion: 2.20 time: 0.493845 Feb 19 02:28:08.005915 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-eecd3d14-ec51-4dcb-a18e-adfc1dd427bb tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Going to run 1 instances... {{(pid=98194) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 02:28:08.006568 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 152/302] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:28:07 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 19 02:28:08.008850 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-eecd3d14-ec51-4dcb-a18e-adfc1dd427bb tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f5b5f904-128e-4b00-b03a-3433a0a0e7fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37a0f9d8-d3f7-417e-bce6-371e41a47c88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 02:28:08.013089 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4bfe6168-2f2d-47b2-816e-988f2347c988 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:08.013863 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-4bfe6168-2f2d-47b2-816e-988f2347c988 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:08.022555 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4bfe6168-2f2d-47b2-816e-988f2347c988 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:08.023418 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4bfe6168-2f2d-47b2-816e-988f2347c988 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:08.024571 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4bfe6168-2f2d-47b2-816e-988f2347c988 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:08.025598 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4bfe6168-2f2d-47b2-816e-988f2347c988 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:08.061625 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-eecd3d14-ec51-4dcb-a18e-adfc1dd427bb tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.805825 Feb 19 02:28:08.062317 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 151/303] 10.222.0.44 () {60 vars in 1137 bytes} [Fri Feb 19 02:28:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 02:28:08.068147 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e29a56ea-7f67-493f-a952-d4f873df352b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:08.069530 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e29a56ea-7f67-493f-a952-d4f873df352b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:08.079187 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e29a56ea-7f67-493f-a952-d4f873df352b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:08.079711 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e29a56ea-7f67-493f-a952-d4f873df352b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:08.080828 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e29a56ea-7f67-493f-a952-d4f873df352b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:08.081324 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e29a56ea-7f67-493f-a952-d4f873df352b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:08.225250 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e29a56ea-7f67-493f-a952-d4f873df352b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 34009 microversion: 2.1 time: 0.161498 Feb 19 02:28:08.226209 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 152/304] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:28:08 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 34009 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:28:08.233721 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-94b20f2f-c7c0-4e61-ae8a-f6d7bfb7f3b6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:08.235051 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-94b20f2f-c7c0-4e61-ae8a-f6d7bfb7f3b6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:08.245698 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-94b20f2f-c7c0-4e61-ae8a-f6d7bfb7f3b6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:08.246216 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-94b20f2f-c7c0-4e61-ae8a-f6d7bfb7f3b6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:08.247121 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-94b20f2f-c7c0-4e61-ae8a-f6d7bfb7f3b6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:08.247620 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-94b20f2f-c7c0-4e61-ae8a-f6d7bfb7f3b6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:08.255174 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-4bfe6168-2f2d-47b2-816e-988f2347c988 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:08.272418 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-4bfe6168-2f2d-47b2-816e-988f2347c988 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1522 microversion: 2.1 time: 0.263979 Feb 19 02:28:08.273661 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 153/305] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:08 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:08.289569 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f2f30d86-0413-4b21-b793-9f5f91c96383 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:08.290229 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f2f30d86-0413-4b21-b793-9f5f91c96383 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f5b5f904-128e-4b00-b03a-3433a0a0e7fb] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:08.375537 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f2f30d86-0413-4b21-b793-9f5f91c96383 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:08.385030 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f2f30d86-0413-4b21-b793-9f5f91c96383 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb" status: 200 len: 1218 microversion: 2.1 time: 0.109102 Feb 19 02:28:08.390921 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 154/306] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:08 2021] GET /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:08.396833 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-bad96cd7-419c-48b1-bbe1-2f3037a157a2 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:08.397510 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-bad96cd7-419c-48b1-bbe1-2f3037a157a2 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: a8f51745-ea4b-4e85-9ba3-ada6a215cb7b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:08.409067 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bad96cd7-419c-48b1-bbe1-2f3037a157a2 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:08.409583 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bad96cd7-419c-48b1-bbe1-2f3037a157a2 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:08.410615 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bad96cd7-419c-48b1-bbe1-2f3037a157a2 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:08.411435 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bad96cd7-419c-48b1-bbe1-2f3037a157a2 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:08.501670 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-94b20f2f-c7c0-4e61-ae8a-f6d7bfb7f3b6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:08.516942 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-94b20f2f-c7c0-4e61-ae8a-f6d7bfb7f3b6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:08.518571 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-94b20f2f-c7c0-4e61-ae8a-f6d7bfb7f3b6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:08.520397 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-94b20f2f-c7c0-4e61-ae8a-f6d7bfb7f3b6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1722 microversion: 2.20 time: 0.292426 Feb 19 02:28:08.520638 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 153/307] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:08 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1722 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:28:08.638181 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-bad96cd7-419c-48b1-bbe1-2f3037a157a2 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5457e8bd9454f33a5f2c47221c8f018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b706884b7904a598558fe41d1d16d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:08.647333 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-bad96cd7-419c-48b1-bbe1-2f3037a157a2 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b" status: 200 len: 1502 microversion: 2.1 time: 0.255047 Feb 19 02:28:08.647951 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 155/308] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:08 2021] GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b => generated 1502 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:09.241734 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-680352c7-1667-4874-8bf5-2b515107c0bd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:09.243020 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-680352c7-1667-4874-8bf5-2b515107c0bd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:09.253163 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-680352c7-1667-4874-8bf5-2b515107c0bd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:09.253656 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-680352c7-1667-4874-8bf5-2b515107c0bd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:09.254690 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-680352c7-1667-4874-8bf5-2b515107c0bd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:09.255184 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-680352c7-1667-4874-8bf5-2b515107c0bd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:09.293145 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f00a0884-651f-4741-aca6-67cc53bd8b67 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:09.293999 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f00a0884-651f-4741-aca6-67cc53bd8b67 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:09.302593 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f00a0884-651f-4741-aca6-67cc53bd8b67 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:09.303262 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f00a0884-651f-4741-aca6-67cc53bd8b67 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:09.316080 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f00a0884-651f-4741-aca6-67cc53bd8b67 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:09.324537 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f00a0884-651f-4741-aca6-67cc53bd8b67 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:09.412384 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-680352c7-1667-4874-8bf5-2b515107c0bd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 34681 microversion: 2.1 time: 0.175114 Feb 19 02:28:09.413094 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 154/309] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:28:09 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 34681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:28:09.422135 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-34385f7f-c6e1-4341-a752-0a17e9d5a5a7 req-270c6974-9e9d-4751-b978-5064082ec7af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8f51745-ea4b-4e85-9ba3-ada6a215cb7b", "name": "network-vif-unplugged", "status": "completed", "tag": "04018fdb-62b7-43ab-886c-080bcd1b112f"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:09.429299 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:28:09.429299 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:28:09.440341 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-34385f7f-c6e1-4341-a752-0a17e9d5a5a7 req-270c6974-9e9d-4751-b978-5064082ec7af service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:09.441002 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-34385f7f-c6e1-4341-a752-0a17e9d5a5a7 req-270c6974-9e9d-4751-b978-5064082ec7af service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:09.462110 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-34385f7f-c6e1-4341-a752-0a17e9d5a5a7 req-270c6974-9e9d-4751-b978-5064082ec7af service nova] Creating event network-vif-unplugged:04018fdb-62b7-43ab-886c-080bcd1b112f for instance a8f51745-ea4b-4e85-9ba3-ada6a215cb7b on hv-cinder-77642 Feb 19 02:28:09.468824 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-34385f7f-c6e1-4341-a752-0a17e9d5a5a7 req-270c6974-9e9d-4751-b978-5064082ec7af service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054025 Feb 19 02:28:09.469774 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 155/310] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:28:09 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:28:09.476052 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-323b4dba-40f3-46ba-9f86-e4dd538b016b tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:09.477241 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-323b4dba-40f3-46ba-9f86-e4dd538b016b tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f5b5f904-128e-4b00-b03a-3433a0a0e7fb] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:09.489806 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-323b4dba-40f3-46ba-9f86-e4dd538b016b tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:09.490659 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-323b4dba-40f3-46ba-9f86-e4dd538b016b tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:09.491840 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-323b4dba-40f3-46ba-9f86-e4dd538b016b tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:09.492968 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-323b4dba-40f3-46ba-9f86-e4dd538b016b tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:09.747023 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f00a0884-651f-4741-aca6-67cc53bd8b67 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:09.757355 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f00a0884-651f-4741-aca6-67cc53bd8b67 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1522 microversion: 2.1 time: 0.468919 Feb 19 02:28:09.758050 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 156/311] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:09 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1522 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:09.763584 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f34098dc-f6ab-4434-a907-c2f32313a860 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:09.764580 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f34098dc-f6ab-4434-a907-c2f32313a860 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:09.773584 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f34098dc-f6ab-4434-a907-c2f32313a860 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:09.775281 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f34098dc-f6ab-4434-a907-c2f32313a860 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:09.776349 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f34098dc-f6ab-4434-a907-c2f32313a860 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:09.776852 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f34098dc-f6ab-4434-a907-c2f32313a860 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:09.865654 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-323b4dba-40f3-46ba-9f86-e4dd538b016b tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:09.874112 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-323b4dba-40f3-46ba-9f86-e4dd538b016b tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb" status: 200 len: 1278 microversion: 2.1 time: 0.402979 Feb 19 02:28:09.875068 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 156/312] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:09 2021] GET /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb => generated 1278 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:09.879727 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4d5173a8-33f4-43bb-b03e-63a89233da92 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:09.880402 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-4d5173a8-33f4-43bb-b03e-63a89233da92 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: a8f51745-ea4b-4e85-9ba3-ada6a215cb7b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:09.888841 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4d5173a8-33f4-43bb-b03e-63a89233da92 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:09.889347 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4d5173a8-33f4-43bb-b03e-63a89233da92 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:09.890206 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4d5173a8-33f4-43bb-b03e-63a89233da92 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:09.890731 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4d5173a8-33f4-43bb-b03e-63a89233da92 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:10.015465 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f34098dc-f6ab-4434-a907-c2f32313a860 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:10.026111 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f34098dc-f6ab-4434-a907-c2f32313a860 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:10.027738 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f34098dc-f6ab-4434-a907-c2f32313a860 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:10.029031 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f34098dc-f6ab-4434-a907-c2f32313a860 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1722 microversion: 2.20 time: 0.269580 Feb 19 02:28:10.029849 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 157/313] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:09 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1722 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:28:10.400801 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-4d5173a8-33f4-43bb-b03e-63a89233da92 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5457e8bd9454f33a5f2c47221c8f018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b706884b7904a598558fe41d1d16d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:10.425432 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-4d5173a8-33f4-43bb-b03e-63a89233da92 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b" status: 200 len: 1502 microversion: 2.1 time: 0.548684 Feb 19 02:28:10.427593 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 157/314] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:09 2021] GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b => generated 1502 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:10.433759 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-75dd4501-4e78-4c1b-b514-d51364b57426 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:10.435434 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-75dd4501-4e78-4c1b-b514-d51364b57426 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:10.446535 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-75dd4501-4e78-4c1b-b514-d51364b57426 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:10.447077 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-75dd4501-4e78-4c1b-b514-d51364b57426 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:10.447932 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-75dd4501-4e78-4c1b-b514-d51364b57426 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:10.448425 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-75dd4501-4e78-4c1b-b514-d51364b57426 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:10.673428 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-75dd4501-4e78-4c1b-b514-d51364b57426 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 35420 microversion: 2.1 time: 0.251699 Feb 19 02:28:10.678855 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 158/315] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:28:10 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 35420 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 19 02:28:10.776445 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4884a4f6-dbb5-4924-aea7-a5d131ac3f5d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:10.777787 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-4884a4f6-dbb5-4924-aea7-a5d131ac3f5d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:10.786331 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4884a4f6-dbb5-4924-aea7-a5d131ac3f5d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:10.787231 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4884a4f6-dbb5-4924-aea7-a5d131ac3f5d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:10.788471 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4884a4f6-dbb5-4924-aea7-a5d131ac3f5d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:10.789189 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4884a4f6-dbb5-4924-aea7-a5d131ac3f5d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:10.898532 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-0d065287-520a-4cf4-a517-4bd3f76a6018 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:10.899715 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-0d065287-520a-4cf4-a517-4bd3f76a6018 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f5b5f904-128e-4b00-b03a-3433a0a0e7fb] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:10.932051 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0d065287-520a-4cf4-a517-4bd3f76a6018 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:10.932782 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0d065287-520a-4cf4-a517-4bd3f76a6018 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:10.934029 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0d065287-520a-4cf4-a517-4bd3f76a6018 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:10.935046 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0d065287-520a-4cf4-a517-4bd3f76a6018 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:11.182274 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-0d065287-520a-4cf4-a517-4bd3f76a6018 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:11.196415 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-0d065287-520a-4cf4-a517-4bd3f76a6018 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb" status: 200 len: 1276 microversion: 2.1 time: 0.305776 Feb 19 02:28:11.197993 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 159/316] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:10 2021] GET /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb => generated 1276 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:11.204879 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f92c4ed2-ad72-416c-a035-2c837d2ea1f3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:11.225293 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f92c4ed2-ad72-416c-a035-2c837d2ea1f3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:11.233590 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f92c4ed2-ad72-416c-a035-2c837d2ea1f3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:11.234103 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f92c4ed2-ad72-416c-a035-2c837d2ea1f3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:11.235024 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f92c4ed2-ad72-416c-a035-2c837d2ea1f3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:11.235519 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f92c4ed2-ad72-416c-a035-2c837d2ea1f3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:11.320242 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-4884a4f6-dbb5-4924-aea7-a5d131ac3f5d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:11.331349 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-4884a4f6-dbb5-4924-aea7-a5d131ac3f5d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1522 microversion: 2.1 time: 0.559410 Feb 19 02:28:11.339880 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 158/317] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:10 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1522 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:11.355525 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-13cbde2b-af5e-45d1-9075-3e096c63adb7 req-7c9180b3-b137-40b0-ae72-83f8c91506af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8f51745-ea4b-4e85-9ba3-ada6a215cb7b", "name": "network-vif-deleted", "tag": "04018fdb-62b7-43ab-886c-080bcd1b112f"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:11.357809 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:28:11.357809 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:28:11.378736 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-13cbde2b-af5e-45d1-9075-3e096c63adb7 req-7c9180b3-b137-40b0-ae72-83f8c91506af service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:11.379451 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-13cbde2b-af5e-45d1-9075-3e096c63adb7 req-7c9180b3-b137-40b0-ae72-83f8c91506af service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:11.400694 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-13cbde2b-af5e-45d1-9075-3e096c63adb7 req-7c9180b3-b137-40b0-ae72-83f8c91506af service nova] Creating event network-vif-deleted:04018fdb-62b7-43ab-886c-080bcd1b112f for instance a8f51745-ea4b-4e85-9ba3-ada6a215cb7b on hv-cinder-77642 Feb 19 02:28:11.406188 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-13cbde2b-af5e-45d1-9075-3e096c63adb7 req-7c9180b3-b137-40b0-ae72-83f8c91506af service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062579 Feb 19 02:28:11.406900 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 159/318] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:28:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:28:11.448223 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b4a648aa-0f6b-4190-a1fc-7405cda5fa9f tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:11.472189 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b4a648aa-0f6b-4190-a1fc-7405cda5fa9f tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: a8f51745-ea4b-4e85-9ba3-ada6a215cb7b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:11.485141 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b4a648aa-0f6b-4190-a1fc-7405cda5fa9f tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:11.485654 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b4a648aa-0f6b-4190-a1fc-7405cda5fa9f tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:11.486587 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b4a648aa-0f6b-4190-a1fc-7405cda5fa9f tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:11.487085 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b4a648aa-0f6b-4190-a1fc-7405cda5fa9f tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:11.604298 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b4a648aa-0f6b-4190-a1fc-7405cda5fa9f tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:11.605844 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b4a648aa-0f6b-4190-a1fc-7405cda5fa9f tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:11.606600 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.objects.instance [None req-b4a648aa-0f6b-4190-a1fc-7405cda5fa9f tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lazy-loading 'fault' on Instance uuid a8f51745-ea4b-4e85-9ba3-ada6a215cb7b {{(pid=98194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 02:28:11.686047 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b4a648aa-0f6b-4190-a1fc-7405cda5fa9f tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5457e8bd9454f33a5f2c47221c8f018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b706884b7904a598558fe41d1d16d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:11.696533 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b4a648aa-0f6b-4190-a1fc-7405cda5fa9f tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b" status: 200 len: 1303 microversion: 2.1 time: 0.254109 Feb 19 02:28:11.697889 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 160/319] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:11 2021] GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b => generated 1303 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:11.703164 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d132e124-16c3-40e3-b078-3bd6874268e2 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:11.704509 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d132e124-16c3-40e3-b078-3bd6874268e2 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:11.714033 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d132e124-16c3-40e3-b078-3bd6874268e2 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:11.714033 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d132e124-16c3-40e3-b078-3bd6874268e2 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:11.725604 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d132e124-16c3-40e3-b078-3bd6874268e2 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:11.726651 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d132e124-16c3-40e3-b078-3bd6874268e2 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:11.740154 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f92c4ed2-ad72-416c-a035-2c837d2ea1f3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:11.787416 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f92c4ed2-ad72-416c-a035-2c837d2ea1f3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:11.791618 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f92c4ed2-ad72-416c-a035-2c837d2ea1f3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:11.794758 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f92c4ed2-ad72-416c-a035-2c837d2ea1f3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1722 microversion: 2.20 time: 0.594849 Feb 19 02:28:11.810857 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 160/320] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:11 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1722 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:28:11.927478 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d132e124-16c3-40e3-b078-3bd6874268e2 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 36239 microversion: 2.1 time: 0.227791 Feb 19 02:28:11.929125 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 161/321] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:28:11 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 36239 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:28:12.218856 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-042f3ecd-0eb6-47df-a462-58ec906974c4 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:12.219828 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-042f3ecd-0eb6-47df-a462-58ec906974c4 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f5b5f904-128e-4b00-b03a-3433a0a0e7fb] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:12.232102 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-042f3ecd-0eb6-47df-a462-58ec906974c4 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:12.232759 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-042f3ecd-0eb6-47df-a462-58ec906974c4 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:12.233873 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-042f3ecd-0eb6-47df-a462-58ec906974c4 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:12.234700 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-042f3ecd-0eb6-47df-a462-58ec906974c4 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:12.353804 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-222fb17e-9b59-4d2e-a067-5e3682e306e5 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:12.355011 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-222fb17e-9b59-4d2e-a067-5e3682e306e5 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:12.365686 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-222fb17e-9b59-4d2e-a067-5e3682e306e5 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:12.366202 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-222fb17e-9b59-4d2e-a067-5e3682e306e5 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:12.367183 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-222fb17e-9b59-4d2e-a067-5e3682e306e5 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:12.367682 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-222fb17e-9b59-4d2e-a067-5e3682e306e5 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:12.480149 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-042f3ecd-0eb6-47df-a462-58ec906974c4 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:12.489208 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-042f3ecd-0eb6-47df-a462-58ec906974c4 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb" status: 200 len: 1318 microversion: 2.1 time: 0.275575 Feb 19 02:28:12.490067 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 161/322] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:12 2021] GET /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:12.717798 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e090f534-5ac5-41d1-82c8-405d6cde3d7d tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:12.718540 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e090f534-5ac5-41d1-82c8-405d6cde3d7d tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: a8f51745-ea4b-4e85-9ba3-ada6a215cb7b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:12.726735 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e090f534-5ac5-41d1-82c8-405d6cde3d7d tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:12.727281 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e090f534-5ac5-41d1-82c8-405d6cde3d7d tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:12.728062 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e090f534-5ac5-41d1-82c8-405d6cde3d7d tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:12.728545 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e090f534-5ac5-41d1-82c8-405d6cde3d7d tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:12.782012 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-e090f534-5ac5-41d1-82c8-405d6cde3d7d tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] HTTP exception thrown: Instance a8f51745-ea4b-4e85-9ba3-ada6a215cb7b could not be found. Feb 19 02:28:12.782707 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e090f534-5ac5-41d1-82c8-405d6cde3d7d tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Returning 404 to user: Instance a8f51745-ea4b-4e85-9ba3-ada6a215cb7b could not be found. {{(pid=98193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:28:12.783622 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e090f534-5ac5-41d1-82c8-405d6cde3d7d tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b" status: 404 len: 111 microversion: 2.1 time: 0.071813 Feb 19 02:28:12.784248 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 162/323] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:12 2021] GET /compute/v2.1/servers/a8f51745-ea4b-4e85-9ba3-ada6a215cb7b => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 02:28:12.827361 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5f435a39-8302-453b-8a3e-39f6c7488f4a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:12.827955 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5f435a39-8302-453b-8a3e-39f6c7488f4a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:12.835826 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5f435a39-8302-453b-8a3e-39f6c7488f4a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:12.836594 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5f435a39-8302-453b-8a3e-39f6c7488f4a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:12.837254 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5f435a39-8302-453b-8a3e-39f6c7488f4a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:12.837703 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5f435a39-8302-453b-8a3e-39f6c7488f4a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:12.865156 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-222fb17e-9b59-4d2e-a067-5e3682e306e5 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:12.878792 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-222fb17e-9b59-4d2e-a067-5e3682e306e5 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1502 microversion: 2.1 time: 0.530976 Feb 19 02:28:12.879716 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 162/324] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:12 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1502 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:12.897079 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a63e77bf-407d-494e-8b6b-0254cb117ff4 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0ce04de-cc4f-474b-8cff-70939d64c166"}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:12.898766 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a63e77bf-407d-494e-8b6b-0254cb117ff4 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:12.907985 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a63e77bf-407d-494e-8b6b-0254cb117ff4 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:12.908816 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a63e77bf-407d-494e-8b6b-0254cb117ff4 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:12.909673 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a63e77bf-407d-494e-8b6b-0254cb117ff4 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:12.910167 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a63e77bf-407d-494e-8b6b-0254cb117ff4 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:13.001118 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-a63e77bf-407d-494e-8b6b-0254cb117ff4 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] HTTP exception thrown: Cannot 'attach_volume' instance c0a55cfa-c2c0-48e5-b519-53c9b68c38cd while it is in vm_state rescued Feb 19 02:28:13.001789 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a63e77bf-407d-494e-8b6b-0254cb117ff4 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Returning 409 to user: Cannot 'attach_volume' instance c0a55cfa-c2c0-48e5-b519-53c9b68c38cd while it is in vm_state rescued {{(pid=98194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:28:13.002762 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a63e77bf-407d-494e-8b6b-0254cb117ff4 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "POST /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.109774 Feb 19 02:28:13.006916 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 163/325] 10.222.0.44 () {60 vars in 1313 bytes} [Fri Feb 19 02:28:12 2021] POST /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd/os-volume_attachments => generated 152 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Feb 19 02:28:13.008362 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1e1d308d-028b-4538-b230-6774a5fa598d tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1840857848", "imageRef": "37a0f9d8-d3f7-417e-bce6-371e41a47c88", "flavorRef": "452", "networks": [{"uuid": "1bc79e11-006d-4d02-867b-ccd717770aea"}]}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:13.101771 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-1e1d308d-028b-4538-b230-6774a5fa598d tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] validate_networks() for [('1bc79e11-006d-4d02-867b-ccd717770aea', None, None, None)] {{(pid=98194) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 02:28:13.108132 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5f435a39-8302-453b-8a3e-39f6c7488f4a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:13.125895 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5f435a39-8302-453b-8a3e-39f6c7488f4a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:13.128229 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5f435a39-8302-453b-8a3e-39f6c7488f4a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:13.130195 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5f435a39-8302-453b-8a3e-39f6c7488f4a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1722 microversion: 2.20 time: 0.308723 Feb 19 02:28:13.135094 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 163/326] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:12 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1722 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 02:28:13.138087 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e420b937-8596-43ac-8029-6de22c615796 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:13.139575 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e420b937-8596-43ac-8029-6de22c615796 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:13.160129 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e420b937-8596-43ac-8029-6de22c615796 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:13.160951 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e420b937-8596-43ac-8029-6de22c615796 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:13.162271 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e420b937-8596-43ac-8029-6de22c615796 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:13.163114 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e420b937-8596-43ac-8029-6de22c615796 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:13.334297 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e420b937-8596-43ac-8029-6de22c615796 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 37468 microversion: 2.1 time: 0.201604 Feb 19 02:28:13.335313 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 164/327] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:28:13 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 37468 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:28:13.341053 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-68d9f61c-564d-464c-a891-09bdfe29f5c9 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:13.342201 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-68d9f61c-564d-464c-a891-09bdfe29f5c9 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:13.351235 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-68d9f61c-564d-464c-a891-09bdfe29f5c9 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:13.351741 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-68d9f61c-564d-464c-a891-09bdfe29f5c9 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:13.352636 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-68d9f61c-564d-464c-a891-09bdfe29f5c9 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:13.353955 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-68d9f61c-564d-464c-a891-09bdfe29f5c9 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:13.502920 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-68d9f61c-564d-464c-a891-09bdfe29f5c9 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "POST /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd/action" status: 202 len: 0 microversion: 2.1 time: 0.166056 Feb 19 02:28:13.506537 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 165/328] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:28:13 2021] POST /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:28:13.509808 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-936b3e7f-ebcf-433d-8ba4-010c605017fa req-1d225e9e-a9da-4b98-84dd-a27abb1516c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5b5f904-128e-4b00-b03a-3433a0a0e7fb", "tag": "1fd8fd6a-2729-467c-9613-3df4488a3a59"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:13.519078 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:28:13.519078 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:28:13.532339 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-936b3e7f-ebcf-433d-8ba4-010c605017fa req-1d225e9e-a9da-4b98-84dd-a27abb1516c9 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:13.532850 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-936b3e7f-ebcf-433d-8ba4-010c605017fa req-1d225e9e-a9da-4b98-84dd-a27abb1516c9 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:13.558158 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-936b3e7f-ebcf-433d-8ba4-010c605017fa req-1d225e9e-a9da-4b98-84dd-a27abb1516c9 service nova] Creating event network-changed:1fd8fd6a-2729-467c-9613-3df4488a3a59 for instance f5b5f904-128e-4b00-b03a-3433a0a0e7fb on hv-cinder-77642 Feb 19 02:28:13.563874 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-936b3e7f-ebcf-433d-8ba4-010c605017fa req-1d225e9e-a9da-4b98-84dd-a27abb1516c9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058470 Feb 19 02:28:13.564530 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 166/329] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:28:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:28:13.569894 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-49fb742e-4972-4b83-990d-0c7c56931a5d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:13.571175 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-49fb742e-4972-4b83-990d-0c7c56931a5d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f5b5f904-128e-4b00-b03a-3433a0a0e7fb] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:13.579989 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-49fb742e-4972-4b83-990d-0c7c56931a5d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:13.580496 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-49fb742e-4972-4b83-990d-0c7c56931a5d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:13.581332 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-49fb742e-4972-4b83-990d-0c7c56931a5d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:13.581822 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-49fb742e-4972-4b83-990d-0c7c56931a5d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:14.007201 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-49fb742e-4972-4b83-990d-0c7c56931a5d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:14.032975 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-49fb742e-4972-4b83-990d-0c7c56931a5d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb" status: 200 len: 1318 microversion: 2.1 time: 0.466760 Feb 19 02:28:14.034882 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 167/330] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:13 2021] GET /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb => generated 1318 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:14.043053 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-75171a4a-b0b1-4e57-bc69-8a8a54bf1ec7 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:14.044107 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-75171a4a-b0b1-4e57-bc69-8a8a54bf1ec7 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:14.059337 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-75171a4a-b0b1-4e57-bc69-8a8a54bf1ec7 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:14.059883 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-75171a4a-b0b1-4e57-bc69-8a8a54bf1ec7 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:14.061596 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-75171a4a-b0b1-4e57-bc69-8a8a54bf1ec7 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:14.061596 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-75171a4a-b0b1-4e57-bc69-8a8a54bf1ec7 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:14.425414 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-1e1d308d-028b-4538-b230-6774a5fa598d tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Flavor limits 0:0:0 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 02:28:14.426005 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-1e1d308d-028b-4538-b230-6774a5fa598d tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Image limits 0:0:0 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 02:28:14.427457 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-1e1d308d-028b-4538-b230-6774a5fa598d tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Flavor pref 0:0:0 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 02:28:14.428598 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-1e1d308d-028b-4538-b230-6774a5fa598d tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Image pref 0:0:0 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 02:28:14.429340 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-1e1d308d-028b-4538-b230-6774a5fa598d tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 02:28:14.441086 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1e1d308d-028b-4538-b230-6774a5fa598d tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:14.442346 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1e1d308d-028b-4538-b230-6774a5fa598d tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:14.443590 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1e1d308d-028b-4538-b230-6774a5fa598d tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:14.444268 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1e1d308d-028b-4538-b230-6774a5fa598d tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:14.471945 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-1e1d308d-028b-4538-b230-6774a5fa598d tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Getting quotas for project 2b706884b7904a598558fe41d1d16d26. Resources: {'ram', 'instances', 'cores'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:28:14.477050 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-1e1d308d-028b-4538-b230-6774a5fa598d tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Getting quotas for user d5457e8bd9454f33a5f2c47221c8f018 and project 2b706884b7904a598558fe41d1d16d26. Resources: {'ram', 'instances', 'cores'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:28:14.491579 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1e1d308d-028b-4538-b230-6774a5fa598d tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Going to run 1 instances... {{(pid=98194) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 02:28:14.495948 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1e1d308d-028b-4538-b230-6774a5fa598d tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: c5a44231-8bb9-429c-8b52-046ccb23313e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37a0f9d8-d3f7-417e-bce6-371e41a47c88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 02:28:14.556697 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1e1d308d-028b-4538-b230-6774a5fa598d tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.552248 Feb 19 02:28:14.558145 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 164/331] 10.222.0.44 () {60 vars in 1137 bytes} [Fri Feb 19 02:28:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 1554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 02:28:14.566476 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-fd167289-7533-491e-ad63-f942268c1826 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:14.567795 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-fd167289-7533-491e-ad63-f942268c1826 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:14.580042 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fd167289-7533-491e-ad63-f942268c1826 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:14.580888 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fd167289-7533-491e-ad63-f942268c1826 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:14.581757 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fd167289-7533-491e-ad63-f942268c1826 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:14.582260 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fd167289-7533-491e-ad63-f942268c1826 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:14.666807 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-75171a4a-b0b1-4e57-bc69-8a8a54bf1ec7 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:14.677637 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-75171a4a-b0b1-4e57-bc69-8a8a54bf1ec7 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1510 microversion: 2.1 time: 0.640707 Feb 19 02:28:14.678279 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 168/332] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:14 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1510 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:14.695099 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-398bf013-0847-4448-bb31-23c3d73387e4 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:14.697238 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-398bf013-0847-4448-bb31-23c3d73387e4 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:14.707711 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-398bf013-0847-4448-bb31-23c3d73387e4 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:14.708225 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-398bf013-0847-4448-bb31-23c3d73387e4 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:14.709089 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-398bf013-0847-4448-bb31-23c3d73387e4 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:14.710566 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-398bf013-0847-4448-bb31-23c3d73387e4 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:14.874011 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-398bf013-0847-4448-bb31-23c3d73387e4 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 38136 microversion: 2.1 time: 0.182301 Feb 19 02:28:14.874937 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 169/333] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:28:14 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 38136 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:28:14.886188 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-03e0967e-25fd-4307-9081-16c10107d4de tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:14.887204 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-03e0967e-25fd-4307-9081-16c10107d4de tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: c5a44231-8bb9-429c-8b52-046ccb23313e] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:15.041351 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-fd167289-7533-491e-ad63-f942268c1826 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:15.051768 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-fd167289-7533-491e-ad63-f942268c1826 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:15.053633 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-fd167289-7533-491e-ad63-f942268c1826 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:15.055118 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-fd167289-7533-491e-ad63-f942268c1826 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1722 microversion: 2.20 time: 0.495586 Feb 19 02:28:15.055719 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 165/334] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:14 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1722 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:28:15.061377 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-436e1ad9-cf2f-46b4-a602-7b7e2ee0e5aa tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:15.062254 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-436e1ad9-cf2f-46b4-a602-7b7e2ee0e5aa tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f5b5f904-128e-4b00-b03a-3433a0a0e7fb] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:15.070521 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-436e1ad9-cf2f-46b4-a602-7b7e2ee0e5aa tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:15.071267 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-436e1ad9-cf2f-46b4-a602-7b7e2ee0e5aa tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:15.072872 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-436e1ad9-cf2f-46b4-a602-7b7e2ee0e5aa tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:15.073368 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-436e1ad9-cf2f-46b4-a602-7b7e2ee0e5aa tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:15.114576 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-03e0967e-25fd-4307-9081-16c10107d4de tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5457e8bd9454f33a5f2c47221c8f018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b706884b7904a598558fe41d1d16d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:15.126500 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-03e0967e-25fd-4307-9081-16c10107d4de tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "GET /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e" status: 200 len: 1214 microversion: 2.1 time: 0.245816 Feb 19 02:28:15.131100 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 170/335] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:14 2021] GET /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e => generated 1214 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:15.596430 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-436e1ad9-cf2f-46b4-a602-7b7e2ee0e5aa tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:15.607364 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-436e1ad9-cf2f-46b4-a602-7b7e2ee0e5aa tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb" status: 200 len: 1318 microversion: 2.1 time: 0.549671 Feb 19 02:28:15.607994 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 166/336] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:15 2021] GET /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb => generated 1318 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:15.696789 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4941f4ca-6680-4c26-8d15-bb462bf26179 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:15.697315 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-4941f4ca-6680-4c26-8d15-bb462bf26179 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:15.718028 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4941f4ca-6680-4c26-8d15-bb462bf26179 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:15.718564 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4941f4ca-6680-4c26-8d15-bb462bf26179 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:15.719438 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4941f4ca-6680-4c26-8d15-bb462bf26179 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:15.719936 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4941f4ca-6680-4c26-8d15-bb462bf26179 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:15.887787 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-51421e48-dcb5-4e93-9f13-58351e71f309 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:15.888925 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-51421e48-dcb5-4e93-9f13-58351e71f309 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:15.905934 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-51421e48-dcb5-4e93-9f13-58351e71f309 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:15.906742 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-51421e48-dcb5-4e93-9f13-58351e71f309 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:15.907608 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-51421e48-dcb5-4e93-9f13-58351e71f309 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:15.908101 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-51421e48-dcb5-4e93-9f13-58351e71f309 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:16.015930 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-4941f4ca-6680-4c26-8d15-bb462bf26179 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:16.029273 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-4941f4ca-6680-4c26-8d15-bb462bf26179 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1510 microversion: 2.1 time: 0.336532 Feb 19 02:28:16.029849 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 171/337] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:15 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1510 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:16.074927 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-51421e48-dcb5-4e93-9f13-58351e71f309 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 38136 microversion: 2.1 time: 0.191495 Feb 19 02:28:16.076311 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 167/338] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:28:15 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 38136 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 19 02:28:16.081720 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-6c0114d3-0e48-4ced-9ecb-17e8178b0f75 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:16.082409 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-6c0114d3-0e48-4ced-9ecb-17e8178b0f75 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:16.091333 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6c0114d3-0e48-4ced-9ecb-17e8178b0f75 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:16.091837 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6c0114d3-0e48-4ced-9ecb-17e8178b0f75 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:16.092943 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6c0114d3-0e48-4ced-9ecb-17e8178b0f75 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:16.093432 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6c0114d3-0e48-4ced-9ecb-17e8178b0f75 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:16.151622 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-3289ae6c-c706-4ce0-9726-790750c41cac tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:16.152531 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-3289ae6c-c706-4ce0-9726-790750c41cac tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: c5a44231-8bb9-429c-8b52-046ccb23313e] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:16.165378 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3289ae6c-c706-4ce0-9726-790750c41cac tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:16.166162 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3289ae6c-c706-4ce0-9726-790750c41cac tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:16.167123 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3289ae6c-c706-4ce0-9726-790750c41cac tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:16.167885 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3289ae6c-c706-4ce0-9726-790750c41cac tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:16.344727 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-3289ae6c-c706-4ce0-9726-790750c41cac tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5457e8bd9454f33a5f2c47221c8f018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b706884b7904a598558fe41d1d16d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:16.360933 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-3289ae6c-c706-4ce0-9726-790750c41cac tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "GET /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e" status: 200 len: 1274 microversion: 2.1 time: 0.215031 Feb 19 02:28:16.361925 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 168/339] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:16 2021] GET /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e => generated 1274 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:16.411267 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-6c0114d3-0e48-4ced-9ecb-17e8178b0f75 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:16.423855 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-6c0114d3-0e48-4ced-9ecb-17e8178b0f75 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:16.425713 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-6c0114d3-0e48-4ced-9ecb-17e8178b0f75 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:16.427113 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-6c0114d3-0e48-4ced-9ecb-17e8178b0f75 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1722 microversion: 2.20 time: 0.349330 Feb 19 02:28:16.431982 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 172/340] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:16 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1722 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:28:16.629994 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d21d2bcf-1b16-471d-82fd-e5f067760740 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:16.631327 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d21d2bcf-1b16-471d-82fd-e5f067760740 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f5b5f904-128e-4b00-b03a-3433a0a0e7fb] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:16.646066 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d21d2bcf-1b16-471d-82fd-e5f067760740 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:16.647022 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d21d2bcf-1b16-471d-82fd-e5f067760740 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:16.648468 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d21d2bcf-1b16-471d-82fd-e5f067760740 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:16.649321 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d21d2bcf-1b16-471d-82fd-e5f067760740 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:17.049170 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-619e2791-536b-4b64-bef0-8c2a4e9d5f36 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:17.049846 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-619e2791-536b-4b64-bef0-8c2a4e9d5f36 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:17.057822 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-619e2791-536b-4b64-bef0-8c2a4e9d5f36 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:17.058332 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-619e2791-536b-4b64-bef0-8c2a4e9d5f36 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:17.059224 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-619e2791-536b-4b64-bef0-8c2a4e9d5f36 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:17.059698 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-619e2791-536b-4b64-bef0-8c2a4e9d5f36 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:17.305879 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-619e2791-536b-4b64-bef0-8c2a4e9d5f36 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:17.318313 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-619e2791-536b-4b64-bef0-8c2a4e9d5f36 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1510 microversion: 2.1 time: 0.273092 Feb 19 02:28:17.320148 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 173/341] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:17 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1510 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:17.324304 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-daa73863-3912-4fcb-9773-b0f52f43bbe3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:17.325608 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-daa73863-3912-4fcb-9773-b0f52f43bbe3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:17.333870 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-daa73863-3912-4fcb-9773-b0f52f43bbe3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:17.334825 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-daa73863-3912-4fcb-9773-b0f52f43bbe3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:17.335269 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-daa73863-3912-4fcb-9773-b0f52f43bbe3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:17.335760 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-daa73863-3912-4fcb-9773-b0f52f43bbe3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:17.396673 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-d21d2bcf-1b16-471d-82fd-e5f067760740 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:17.409412 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d21d2bcf-1b16-471d-82fd-e5f067760740 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb" status: 200 len: 1318 microversion: 2.1 time: 0.786804 Feb 19 02:28:17.410263 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 169/342] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:16 2021] GET /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb => generated 1318 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:17.424796 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e4354a84-fed4-4476-be80-2ee6a2b31d7e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:17.425211 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e4354a84-fed4-4476-be80-2ee6a2b31d7e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: c5a44231-8bb9-429c-8b52-046ccb23313e] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:17.434655 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e4354a84-fed4-4476-be80-2ee6a2b31d7e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:17.435992 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e4354a84-fed4-4476-be80-2ee6a2b31d7e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:17.437456 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e4354a84-fed4-4476-be80-2ee6a2b31d7e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:17.438617 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e4354a84-fed4-4476-be80-2ee6a2b31d7e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:17.468553 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-daa73863-3912-4fcb-9773-b0f52f43bbe3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 200 len: 38264 microversion: 2.1 time: 0.147929 Feb 19 02:28:17.469479 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 174/343] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:28:17 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 38264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:28:17.476865 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-83017c27-29bb-4dc9-ab27-40c077138c4a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:17.477995 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-83017c27-29bb-4dc9-ab27-40c077138c4a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:17.491806 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-83017c27-29bb-4dc9-ab27-40c077138c4a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:17.491806 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-83017c27-29bb-4dc9-ab27-40c077138c4a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:17.492039 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-83017c27-29bb-4dc9-ab27-40c077138c4a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:17.492341 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-83017c27-29bb-4dc9-ab27-40c077138c4a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:17.615965 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e4354a84-fed4-4476-be80-2ee6a2b31d7e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5457e8bd9454f33a5f2c47221c8f018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b706884b7904a598558fe41d1d16d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:17.627879 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e4354a84-fed4-4476-be80-2ee6a2b31d7e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "GET /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e" status: 200 len: 1272 microversion: 2.1 time: 0.207181 Feb 19 02:28:17.635714 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 170/344] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:17 2021] GET /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e => generated 1272 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:17.643096 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1214d52a-547f-4496-8e3e-2b8383037aef tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:17.643914 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1214d52a-547f-4496-8e3e-2b8383037aef tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:17.653213 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1214d52a-547f-4496-8e3e-2b8383037aef tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:17.653758 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1214d52a-547f-4496-8e3e-2b8383037aef tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:17.655101 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1214d52a-547f-4496-8e3e-2b8383037aef tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:17.655904 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1214d52a-547f-4496-8e3e-2b8383037aef tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:17.728814 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1214d52a-547f-4496-8e3e-2b8383037aef tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/ips" status: 200 len: 144 microversion: 2.1 time: 0.091591 Feb 19 02:28:17.729579 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 171/345] 10.222.0.44 () {58 vars in 1238 bytes} [Fri Feb 19 02:28:17 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/ips => generated 144 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:28:17.800430 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-83017c27-29bb-4dc9-ab27-40c077138c4a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:17.810650 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-83017c27-29bb-4dc9-ab27-40c077138c4a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:17.812234 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-83017c27-29bb-4dc9-ab27-40c077138c4a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:17.813462 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-83017c27-29bb-4dc9-ab27-40c077138c4a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1722 microversion: 2.20 time: 0.342538 Feb 19 02:28:17.814093 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 175/346] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:17 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1722 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:28:18.337975 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5d5fa32f-aa09-4870-b899-b5b900260c28 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:18.340083 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5d5fa32f-aa09-4870-b899-b5b900260c28 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:18.349211 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5d5fa32f-aa09-4870-b899-b5b900260c28 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:18.350819 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5d5fa32f-aa09-4870-b899-b5b900260c28 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:18.351866 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5d5fa32f-aa09-4870-b899-b5b900260c28 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:18.352545 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5d5fa32f-aa09-4870-b899-b5b900260c28 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:18.388801 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-cfd3eb4a-aa37-4862-8b9d-347b53b4c9af req-1ee41e12-94ba-4b2d-b8c3-ecdefb4cf665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5b5f904-128e-4b00-b03a-3433a0a0e7fb", "name": "network-vif-plugged", "status": "completed", "tag": "1fd8fd6a-2729-467c-9613-3df4488a3a59"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:18.390597 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:28:18.390597 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:28:18.401037 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-cfd3eb4a-aa37-4862-8b9d-347b53b4c9af req-1ee41e12-94ba-4b2d-b8c3-ecdefb4cf665 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:18.401658 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-cfd3eb4a-aa37-4862-8b9d-347b53b4c9af req-1ee41e12-94ba-4b2d-b8c3-ecdefb4cf665 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:18.420226 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-cfd3eb4a-aa37-4862-8b9d-347b53b4c9af req-1ee41e12-94ba-4b2d-b8c3-ecdefb4cf665 service nova] Creating event network-vif-plugged:1fd8fd6a-2729-467c-9613-3df4488a3a59 for instance f5b5f904-128e-4b00-b03a-3433a0a0e7fb on hv-cinder-77642 Feb 19 02:28:18.428662 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-cfd3eb4a-aa37-4862-8b9d-347b53b4c9af req-1ee41e12-94ba-4b2d-b8c3-ecdefb4cf665 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043867 Feb 19 02:28:18.430075 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 176/347] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:28:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:28:18.436366 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d86dd0bf-8936-423c-ba4f-0136f033e67d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:18.437514 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d86dd0bf-8936-423c-ba4f-0136f033e67d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f5b5f904-128e-4b00-b03a-3433a0a0e7fb] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:18.446612 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d86dd0bf-8936-423c-ba4f-0136f033e67d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:18.447502 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d86dd0bf-8936-423c-ba4f-0136f033e67d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:18.448453 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d86dd0bf-8936-423c-ba4f-0136f033e67d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:18.449020 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d86dd0bf-8936-423c-ba4f-0136f033e67d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:18.774443 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-d86dd0bf-8936-423c-ba4f-0136f033e67d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:18.787233 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d86dd0bf-8936-423c-ba4f-0136f033e67d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb" status: 200 len: 1318 microversion: 2.1 time: 0.355054 Feb 19 02:28:18.788836 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 177/348] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:18 2021] GET /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb => generated 1318 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:18.801022 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f4dbd6f9-fcd6-4911-9999-020a92fd8298 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:18.805297 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f4dbd6f9-fcd6-4911-9999-020a92fd8298 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: c5a44231-8bb9-429c-8b52-046ccb23313e] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:18.816736 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f4dbd6f9-fcd6-4911-9999-020a92fd8298 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:18.817636 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f4dbd6f9-fcd6-4911-9999-020a92fd8298 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:18.819079 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f4dbd6f9-fcd6-4911-9999-020a92fd8298 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:18.820034 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f4dbd6f9-fcd6-4911-9999-020a92fd8298 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:18.898879 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5d5fa32f-aa09-4870-b899-b5b900260c28 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:18.908735 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5d5fa32f-aa09-4870-b899-b5b900260c28 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1516 microversion: 2.1 time: 0.575170 Feb 19 02:28:18.909655 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 172/349] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:18 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1516 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:18.966264 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-02ddabbe-8705-4a4f-94f4-6902ab4ed9d7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:18.968983 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-02ddabbe-8705-4a4f-94f4-6902ab4ed9d7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:19.007878 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-02ddabbe-8705-4a4f-94f4-6902ab4ed9d7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:19.008855 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-02ddabbe-8705-4a4f-94f4-6902ab4ed9d7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:19.010580 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-02ddabbe-8705-4a4f-94f4-6902ab4ed9d7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:19.011271 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-02ddabbe-8705-4a4f-94f4-6902ab4ed9d7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:19.132093 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f4dbd6f9-fcd6-4911-9999-020a92fd8298 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5457e8bd9454f33a5f2c47221c8f018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b706884b7904a598558fe41d1d16d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:19.142987 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f4dbd6f9-fcd6-4911-9999-020a92fd8298 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "GET /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e" status: 200 len: 1314 microversion: 2.1 time: 0.348516 Feb 19 02:28:19.143639 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 178/350] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:18 2021] GET /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:19.503870 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-02ddabbe-8705-4a4f-94f4-6902ab4ed9d7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:19.516152 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-02ddabbe-8705-4a4f-94f4-6902ab4ed9d7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:19.520128 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-02ddabbe-8705-4a4f-94f4-6902ab4ed9d7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:19.521729 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-02ddabbe-8705-4a4f-94f4-6902ab4ed9d7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1722 microversion: 2.20 time: 0.565325 Feb 19 02:28:19.522595 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 173/351] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:18 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1722 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:28:19.760110 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-30e52efe-484f-4a35-905d-e0d14189b7e0 req-7764bc87-c48a-4736-89e4-1e3a6e82f32e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5a44231-8bb9-429c-8b52-046ccb23313e", "tag": "3583108b-c257-4b21-bfc3-dbd6a990face"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:19.763475 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:28:19.763475 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:28:19.773976 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-30e52efe-484f-4a35-905d-e0d14189b7e0 req-7764bc87-c48a-4736-89e4-1e3a6e82f32e service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:19.774594 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-30e52efe-484f-4a35-905d-e0d14189b7e0 req-7764bc87-c48a-4736-89e4-1e3a6e82f32e service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:19.798013 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-30e52efe-484f-4a35-905d-e0d14189b7e0 req-7764bc87-c48a-4736-89e4-1e3a6e82f32e service nova] Creating event network-changed:3583108b-c257-4b21-bfc3-dbd6a990face for instance c5a44231-8bb9-429c-8b52-046ccb23313e on hv-cinder-77642 Feb 19 02:28:19.803900 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-30e52efe-484f-4a35-905d-e0d14189b7e0 req-7764bc87-c48a-4736-89e4-1e3a6e82f32e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048563 Feb 19 02:28:19.804935 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 179/352] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:28:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:28:19.807373 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-cb1ec84e-af8e-4396-8b63-468e8429fa74 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:19.808231 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-cb1ec84e-af8e-4396-8b63-468e8429fa74 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f5b5f904-128e-4b00-b03a-3433a0a0e7fb] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:19.816534 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cb1ec84e-af8e-4396-8b63-468e8429fa74 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:19.817266 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cb1ec84e-af8e-4396-8b63-468e8429fa74 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:19.818271 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cb1ec84e-af8e-4396-8b63-468e8429fa74 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:19.818970 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cb1ec84e-af8e-4396-8b63-468e8429fa74 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:20.162213 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e8be4dc9-9c4d-4793-ab06-a2ea0fbbeb5e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:20.163017 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e8be4dc9-9c4d-4793-ab06-a2ea0fbbeb5e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: c5a44231-8bb9-429c-8b52-046ccb23313e] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:20.171805 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e8be4dc9-9c4d-4793-ab06-a2ea0fbbeb5e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:20.172323 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e8be4dc9-9c4d-4793-ab06-a2ea0fbbeb5e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:20.173151 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e8be4dc9-9c4d-4793-ab06-a2ea0fbbeb5e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:20.173982 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e8be4dc9-9c4d-4793-ab06-a2ea0fbbeb5e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:20.214292 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-cb1ec84e-af8e-4396-8b63-468e8429fa74 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:20.226785 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-cb1ec84e-af8e-4396-8b63-468e8429fa74 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb" status: 200 len: 1318 microversion: 2.1 time: 0.423799 Feb 19 02:28:20.238483 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 174/353] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:19 2021] GET /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb => generated 1318 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:20.398907 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e8be4dc9-9c4d-4793-ab06-a2ea0fbbeb5e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5457e8bd9454f33a5f2c47221c8f018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b706884b7904a598558fe41d1d16d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:20.410643 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e8be4dc9-9c4d-4793-ab06-a2ea0fbbeb5e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "GET /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e" status: 200 len: 1314 microversion: 2.1 time: 0.252648 Feb 19 02:28:20.422375 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 180/354] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:20 2021] GET /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:28:20.519630 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e83a1c21-e63d-4361-8c14-4b2459fff41a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63444285-7e2a-4670-88d3-2ce36efe8d94"}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:20.520913 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e83a1c21-e63d-4361-8c14-4b2459fff41a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:20.530864 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e83a1c21-e63d-4361-8c14-4b2459fff41a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:20.531583 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e83a1c21-e63d-4361-8c14-4b2459fff41a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:20.532640 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e83a1c21-e63d-4361-8c14-4b2459fff41a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:20.533295 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e83a1c21-e63d-4361-8c14-4b2459fff41a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:20.543610 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e2aaebdc-bec5-4f31-bda6-dac0bb175916 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:20.544983 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e2aaebdc-bec5-4f31-bda6-dac0bb175916 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:20.564808 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e2aaebdc-bec5-4f31-bda6-dac0bb175916 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:20.565907 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e2aaebdc-bec5-4f31-bda6-dac0bb175916 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:20.566901 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e2aaebdc-bec5-4f31-bda6-dac0bb175916 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:20.568493 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e2aaebdc-bec5-4f31-bda6-dac0bb175916 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:20.873382 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e2aaebdc-bec5-4f31-bda6-dac0bb175916 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:20.890879 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e2aaebdc-bec5-4f31-bda6-dac0bb175916 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:20.892447 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e2aaebdc-bec5-4f31-bda6-dac0bb175916 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:20.893691 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e2aaebdc-bec5-4f31-bda6-dac0bb175916 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1722 microversion: 2.20 time: 0.354972 Feb 19 02:28:20.894292 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 181/355] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:20 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1722 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:28:20.900593 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4a4946c4-27f5-4ae1-992e-6fdc644859df tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:20.901908 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-4a4946c4-27f5-4ae1-992e-6fdc644859df tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:20.926840 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4a4946c4-27f5-4ae1-992e-6fdc644859df tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:20.927447 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4a4946c4-27f5-4ae1-992e-6fdc644859df tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:20.928377 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4a4946c4-27f5-4ae1-992e-6fdc644859df tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:20.928938 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4a4946c4-27f5-4ae1-992e-6fdc644859df tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:21.044325 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e83a1c21-e63d-4361-8c14-4b2459fff41a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.528689 Feb 19 02:28:21.046093 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 175/356] 10.222.0.44 () {60 vars in 1313 bytes} [Fri Feb 19 02:28:20 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/os-volume_attachments => generated 194 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:28:21.232779 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-4a4946c4-27f5-4ae1-992e-6fdc644859df tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:21.241730 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-4a4946c4-27f5-4ae1-992e-6fdc644859df tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1516 microversion: 2.1 time: 0.345748 Feb 19 02:28:21.242535 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 182/357] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:20 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1516 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:21.247459 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b0747ffb-c281-4dc6-8e7d-8f4f824dd455 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:21.248230 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b0747ffb-c281-4dc6-8e7d-8f4f824dd455 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f5b5f904-128e-4b00-b03a-3433a0a0e7fb] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:21.257015 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b0747ffb-c281-4dc6-8e7d-8f4f824dd455 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:21.257532 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b0747ffb-c281-4dc6-8e7d-8f4f824dd455 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:21.258387 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b0747ffb-c281-4dc6-8e7d-8f4f824dd455 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:21.259394 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b0747ffb-c281-4dc6-8e7d-8f4f824dd455 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:21.259923 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f2d97d74-183a-41b2-8bb8-9d0b6d870012 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bca9cd62-15ee-4a4a-b207-14630f27db14"}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:21.261308 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f2d97d74-183a-41b2-8bb8-9d0b6d870012 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:21.269348 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f2d97d74-183a-41b2-8bb8-9d0b6d870012 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:21.269859 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f2d97d74-183a-41b2-8bb8-9d0b6d870012 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:21.270906 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f2d97d74-183a-41b2-8bb8-9d0b6d870012 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:21.271512 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f2d97d74-183a-41b2-8bb8-9d0b6d870012 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:21.685044 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b0747ffb-c281-4dc6-8e7d-8f4f824dd455 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:21.694585 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b0747ffb-c281-4dc6-8e7d-8f4f824dd455 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb" status: 200 len: 1506 microversion: 2.1 time: 0.451565 Feb 19 02:28:21.707065 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 176/358] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:21 2021] GET /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb => generated 1506 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:21.714205 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-14fad73d-b884-4613-be37-0157d5007209 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:21.715020 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-14fad73d-b884-4613-be37-0157d5007209 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: c5a44231-8bb9-429c-8b52-046ccb23313e] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:21.723137 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-14fad73d-b884-4613-be37-0157d5007209 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:21.724235 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-14fad73d-b884-4613-be37-0157d5007209 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:21.724725 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-14fad73d-b884-4613-be37-0157d5007209 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:21.725328 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-14fad73d-b884-4613-be37-0157d5007209 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:21.727973 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f2d97d74-183a-41b2-8bb8-9d0b6d870012 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "POST /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.471044 Feb 19 02:28:21.728817 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 183/359] 10.222.0.44 () {60 vars in 1313 bytes} [Fri Feb 19 02:28:21 2021] POST /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd/os-volume_attachments => generated 194 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:28:21.923610 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-09e747c1-58c5-4c0b-a62f-31f7b2205c69 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:21.924627 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-09e747c1-58c5-4c0b-a62f-31f7b2205c69 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:21.939122 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-09e747c1-58c5-4c0b-a62f-31f7b2205c69 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:21.940616 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-09e747c1-58c5-4c0b-a62f-31f7b2205c69 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:21.942156 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-09e747c1-58c5-4c0b-a62f-31f7b2205c69 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:21.943205 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-09e747c1-58c5-4c0b-a62f-31f7b2205c69 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:22.020942 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-14fad73d-b884-4613-be37-0157d5007209 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5457e8bd9454f33a5f2c47221c8f018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b706884b7904a598558fe41d1d16d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:22.031371 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-14fad73d-b884-4613-be37-0157d5007209 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "GET /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e" status: 200 len: 1314 microversion: 2.1 time: 0.322730 Feb 19 02:28:22.032192 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 177/360] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:21 2021] GET /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:22.223401 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-09e747c1-58c5-4c0b-a62f-31f7b2205c69 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:22.232163 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-09e747c1-58c5-4c0b-a62f-31f7b2205c69 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:22.233768 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-09e747c1-58c5-4c0b-a62f-31f7b2205c69 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:22.235037 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-09e747c1-58c5-4c0b-a62f-31f7b2205c69 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1722 microversion: 2.20 time: 0.318223 Feb 19 02:28:22.235952 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 184/361] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:21 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1722 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:28:23.050147 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f5518529-c409-49f6-9c60-17f0dac7307e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:23.050842 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f5518529-c409-49f6-9c60-17f0dac7307e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: c5a44231-8bb9-429c-8b52-046ccb23313e] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:23.058996 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f5518529-c409-49f6-9c60-17f0dac7307e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:23.059502 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f5518529-c409-49f6-9c60-17f0dac7307e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:23.060335 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f5518529-c409-49f6-9c60-17f0dac7307e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:23.060829 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f5518529-c409-49f6-9c60-17f0dac7307e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:23.255229 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-84df2a86-fb96-4ab1-a1e9-7b7ff2896975 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:23.255948 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-84df2a86-fb96-4ab1-a1e9-7b7ff2896975 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:23.264503 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-84df2a86-fb96-4ab1-a1e9-7b7ff2896975 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:23.265013 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-84df2a86-fb96-4ab1-a1e9-7b7ff2896975 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:23.265875 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-84df2a86-fb96-4ab1-a1e9-7b7ff2896975 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:23.266372 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-84df2a86-fb96-4ab1-a1e9-7b7ff2896975 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:23.277668 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f5518529-c409-49f6-9c60-17f0dac7307e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5457e8bd9454f33a5f2c47221c8f018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b706884b7904a598558fe41d1d16d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:23.286662 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f5518529-c409-49f6-9c60-17f0dac7307e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "GET /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e" status: 200 len: 1314 microversion: 2.1 time: 0.240444 Feb 19 02:28:23.287296 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 178/362] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:23 2021] GET /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:23.487617 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-84df2a86-fb96-4ab1-a1e9-7b7ff2896975 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:23.498961 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-84df2a86-fb96-4ab1-a1e9-7b7ff2896975 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:23.501481 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-84df2a86-fb96-4ab1-a1e9-7b7ff2896975 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:23.503051 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-84df2a86-fb96-4ab1-a1e9-7b7ff2896975 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1722 microversion: 2.20 time: 0.251569 Feb 19 02:28:23.504214 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 185/363] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:23 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:28:23.514092 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7fcca44f-c2b7-4844-95aa-54fdebb3a272 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "caaafd9a-0ac7-420f-930d-50259d1ec945"}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:23.515281 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7fcca44f-c2b7-4844-95aa-54fdebb3a272 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f5b5f904-128e-4b00-b03a-3433a0a0e7fb] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:23.523282 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7fcca44f-c2b7-4844-95aa-54fdebb3a272 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:23.523791 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7fcca44f-c2b7-4844-95aa-54fdebb3a272 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:23.525171 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7fcca44f-c2b7-4844-95aa-54fdebb3a272 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:23.525662 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7fcca44f-c2b7-4844-95aa-54fdebb3a272 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:23.919154 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7fcca44f-c2b7-4844-95aa-54fdebb3a272 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "POST /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.409448 Feb 19 02:28:23.919842 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 179/364] 10.222.0.44 () {60 vars in 1313 bytes} [Fri Feb 19 02:28:23 2021] POST /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb/os-volume_attachments => generated 194 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:28:24.305268 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-2d2dec29-f552-471a-89ec-9474c4632122 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:24.306872 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-2d2dec29-f552-471a-89ec-9474c4632122 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: c5a44231-8bb9-429c-8b52-046ccb23313e] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:24.315276 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2d2dec29-f552-471a-89ec-9474c4632122 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:24.315788 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2d2dec29-f552-471a-89ec-9474c4632122 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:24.316640 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2d2dec29-f552-471a-89ec-9474c4632122 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:24.317133 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2d2dec29-f552-471a-89ec-9474c4632122 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:24.535142 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-169668a3-5e1f-4349-aa26-8814c8aec03d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:24.536310 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-169668a3-5e1f-4349-aa26-8814c8aec03d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:24.557258 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-169668a3-5e1f-4349-aa26-8814c8aec03d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:24.558079 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-169668a3-5e1f-4349-aa26-8814c8aec03d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:24.559611 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-169668a3-5e1f-4349-aa26-8814c8aec03d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:24.562431 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-169668a3-5e1f-4349-aa26-8814c8aec03d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:24.599776 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-2d2dec29-f552-471a-89ec-9474c4632122 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5457e8bd9454f33a5f2c47221c8f018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b706884b7904a598558fe41d1d16d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:24.611287 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-2d2dec29-f552-471a-89ec-9474c4632122 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "GET /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e" status: 200 len: 1314 microversion: 2.1 time: 0.309453 Feb 19 02:28:24.621796 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 186/365] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:24 2021] GET /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:24.814293 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-169668a3-5e1f-4349-aa26-8814c8aec03d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:24.824484 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-169668a3-5e1f-4349-aa26-8814c8aec03d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:24.826407 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-169668a3-5e1f-4349-aa26-8814c8aec03d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:24.827677 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-169668a3-5e1f-4349-aa26-8814c8aec03d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1743 microversion: 2.20 time: 0.298011 Feb 19 02:28:24.828288 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 180/366] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:24 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1743 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:28:24.893646 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-4bbcc2ab-2229-49a2-b957-557e6faf3a9b req-591aaafe-b806-43bd-8492-ae491fdf0f72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5a44231-8bb9-429c-8b52-046ccb23313e", "name": "network-vif-plugged", "status": "completed", "tag": "3583108b-c257-4b21-bfc3-dbd6a990face"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:24.895656 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:28:24.895656 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:28:24.905524 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-4bbcc2ab-2229-49a2-b957-557e6faf3a9b req-591aaafe-b806-43bd-8492-ae491fdf0f72 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:24.906325 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-4bbcc2ab-2229-49a2-b957-557e6faf3a9b req-591aaafe-b806-43bd-8492-ae491fdf0f72 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:24.925545 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-4bbcc2ab-2229-49a2-b957-557e6faf3a9b req-591aaafe-b806-43bd-8492-ae491fdf0f72 service nova] Creating event network-vif-plugged:3583108b-c257-4b21-bfc3-dbd6a990face for instance c5a44231-8bb9-429c-8b52-046ccb23313e on hv-cinder-77642 Feb 19 02:28:24.930912 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-4bbcc2ab-2229-49a2-b957-557e6faf3a9b req-591aaafe-b806-43bd-8492-ae491fdf0f72 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041090 Feb 19 02:28:24.931927 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 187/367] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:28:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:28:25.630776 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-10f5b010-bd7b-4846-887f-f82f50116901 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:25.631615 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-10f5b010-bd7b-4846-887f-f82f50116901 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: c5a44231-8bb9-429c-8b52-046ccb23313e] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:25.640424 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-10f5b010-bd7b-4846-887f-f82f50116901 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:25.640799 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-10f5b010-bd7b-4846-887f-f82f50116901 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:25.641818 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-10f5b010-bd7b-4846-887f-f82f50116901 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:25.642715 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-10f5b010-bd7b-4846-887f-f82f50116901 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:25.850950 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-aaa19bd7-2525-42b7-ae4b-f8d0f440e690 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:25.852435 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-aaa19bd7-2525-42b7-ae4b-f8d0f440e690 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:25.861493 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-aaa19bd7-2525-42b7-ae4b-f8d0f440e690 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:25.862012 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-aaa19bd7-2525-42b7-ae4b-f8d0f440e690 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:25.862906 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-aaa19bd7-2525-42b7-ae4b-f8d0f440e690 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:25.863403 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-aaa19bd7-2525-42b7-ae4b-f8d0f440e690 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:25.871759 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-10f5b010-bd7b-4846-887f-f82f50116901 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5457e8bd9454f33a5f2c47221c8f018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b706884b7904a598558fe41d1d16d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:25.882999 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-10f5b010-bd7b-4846-887f-f82f50116901 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "GET /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e" status: 200 len: 1314 microversion: 2.1 time: 0.256158 Feb 19 02:28:25.890571 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 181/368] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:25 2021] GET /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:26.086619 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-aaa19bd7-2525-42b7-ae4b-f8d0f440e690 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:26.096701 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-aaa19bd7-2525-42b7-ae4b-f8d0f440e690 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:26.098280 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-aaa19bd7-2525-42b7-ae4b-f8d0f440e690 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:26.099568 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-aaa19bd7-2525-42b7-ae4b-f8d0f440e690 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1743 microversion: 2.20 time: 0.253990 Feb 19 02:28:26.100187 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 188/369] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:25 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1743 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:28:26.906321 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c0a307d2-21ef-4f41-9813-3d2edf31f442 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:26.907029 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c0a307d2-21ef-4f41-9813-3d2edf31f442 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: c5a44231-8bb9-429c-8b52-046ccb23313e] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:26.915854 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c0a307d2-21ef-4f41-9813-3d2edf31f442 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:26.916563 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c0a307d2-21ef-4f41-9813-3d2edf31f442 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:26.917566 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c0a307d2-21ef-4f41-9813-3d2edf31f442 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:26.918204 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c0a307d2-21ef-4f41-9813-3d2edf31f442 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:27.120176 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b906ce54-d3ba-4059-a8f6-c31a54a7e583 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:27.120845 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b906ce54-d3ba-4059-a8f6-c31a54a7e583 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:27.129152 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b906ce54-d3ba-4059-a8f6-c31a54a7e583 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:27.130278 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b906ce54-d3ba-4059-a8f6-c31a54a7e583 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:27.131153 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b906ce54-d3ba-4059-a8f6-c31a54a7e583 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:27.131828 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b906ce54-d3ba-4059-a8f6-c31a54a7e583 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:27.142248 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c0a307d2-21ef-4f41-9813-3d2edf31f442 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5457e8bd9454f33a5f2c47221c8f018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b706884b7904a598558fe41d1d16d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:27.152021 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c0a307d2-21ef-4f41-9813-3d2edf31f442 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "GET /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e" status: 200 len: 1314 microversion: 2.1 time: 0.250429 Feb 19 02:28:27.152629 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 182/370] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:26 2021] GET /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:27.695776 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b906ce54-d3ba-4059-a8f6-c31a54a7e583 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:27.706148 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b906ce54-d3ba-4059-a8f6-c31a54a7e583 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:27.707980 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b906ce54-d3ba-4059-a8f6-c31a54a7e583 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:27.710306 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b906ce54-d3ba-4059-a8f6-c31a54a7e583 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1738 microversion: 2.20 time: 0.594455 Feb 19 02:28:27.710956 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 189/371] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:27 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1738 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:28:28.173373 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-76647620-c655-4994-8cc3-62808f85dcd1 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:28.174666 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-76647620-c655-4994-8cc3-62808f85dcd1 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: c5a44231-8bb9-429c-8b52-046ccb23313e] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:28.187422 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-76647620-c655-4994-8cc3-62808f85dcd1 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:28.188197 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-76647620-c655-4994-8cc3-62808f85dcd1 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:28.189282 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-76647620-c655-4994-8cc3-62808f85dcd1 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:28.190004 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-76647620-c655-4994-8cc3-62808f85dcd1 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:28.444114 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-76647620-c655-4994-8cc3-62808f85dcd1 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5457e8bd9454f33a5f2c47221c8f018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b706884b7904a598558fe41d1d16d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:28.464232 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-76647620-c655-4994-8cc3-62808f85dcd1 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "GET /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e" status: 200 len: 1496 microversion: 2.1 time: 0.294682 Feb 19 02:28:28.466082 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 183/372] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:28 2021] GET /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e => generated 1496 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:28.731346 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-aab5513c-d0a6-46b6-8902-f3c4408bd2b1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:28.732078 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-aab5513c-d0a6-46b6-8902-f3c4408bd2b1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:28.740707 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-aab5513c-d0a6-46b6-8902-f3c4408bd2b1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:28.741222 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-aab5513c-d0a6-46b6-8902-f3c4408bd2b1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:28.742079 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-aab5513c-d0a6-46b6-8902-f3c4408bd2b1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:28.742602 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-aab5513c-d0a6-46b6-8902-f3c4408bd2b1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:28.973241 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-aab5513c-d0a6-46b6-8902-f3c4408bd2b1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:28.987344 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-aab5513c-d0a6-46b6-8902-f3c4408bd2b1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:28.989198 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-aab5513c-d0a6-46b6-8902-f3c4408bd2b1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:28.990641 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-aab5513c-d0a6-46b6-8902-f3c4408bd2b1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1738 microversion: 2.20 time: 0.263920 Feb 19 02:28:29.002436 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 190/373] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:28 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1738 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 02:28:29.193889 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-94bd3173-e7cd-42f2-82ed-5e26b8fe0e63 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:29.203461 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-94bd3173-e7cd-42f2-82ed-5e26b8fe0e63 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:29.204057 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-94bd3173-e7cd-42f2-82ed-5e26b8fe0e63 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:29.270258 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-94bd3173-e7cd-42f2-82ed-5e26b8fe0e63 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Going to try to stop instance {{(pid=98194) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Feb 19 02:28:29.374842 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-94bd3173-e7cd-42f2-82ed-5e26b8fe0e63 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 202 len: 0 microversion: 2.1 time: 0.194074 Feb 19 02:28:29.375611 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 184/374] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:28:29 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:28:29.396196 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e3724d30-e29b-4a81-99c1-a83a61b17d0a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:29.396944 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e3724d30-e29b-4a81-99c1-a83a61b17d0a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:29.408942 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e3724d30-e29b-4a81-99c1-a83a61b17d0a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:29.409454 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e3724d30-e29b-4a81-99c1-a83a61b17d0a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:29.410316 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e3724d30-e29b-4a81-99c1-a83a61b17d0a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:29.410837 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e3724d30-e29b-4a81-99c1-a83a61b17d0a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:29.682445 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e3724d30-e29b-4a81-99c1-a83a61b17d0a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:29.695939 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e3724d30-e29b-4a81-99c1-a83a61b17d0a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1721 microversion: 2.1 time: 0.308123 Feb 19 02:28:29.696987 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 191/375] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:29 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1721 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:29.820523 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-711d9bf6-4df2-40b9-a18e-995666b24b3a tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:29.821164 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-711d9bf6-4df2-40b9-a18e-995666b24b3a tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: c5a44231-8bb9-429c-8b52-046ccb23313e] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:29.829742 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-711d9bf6-4df2-40b9-a18e-995666b24b3a tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:29.830243 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-711d9bf6-4df2-40b9-a18e-995666b24b3a tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:29.831102 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-711d9bf6-4df2-40b9-a18e-995666b24b3a tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:29.831590 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-711d9bf6-4df2-40b9-a18e-995666b24b3a tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:29.911070 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-711d9bf6-4df2-40b9-a18e-995666b24b3a tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: c5a44231-8bb9-429c-8b52-046ccb23313e] Going to try to terminate instance {{(pid=98194) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 02:28:30.021290 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ee458180-dcf9-4493-b563-0d594d85cb98 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:30.022240 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ee458180-dcf9-4493-b563-0d594d85cb98 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:30.031493 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ee458180-dcf9-4493-b563-0d594d85cb98 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:30.032258 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ee458180-dcf9-4493-b563-0d594d85cb98 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:30.033131 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ee458180-dcf9-4493-b563-0d594d85cb98 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:30.033633 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ee458180-dcf9-4493-b563-0d594d85cb98 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:30.068251 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-711d9bf6-4df2-40b9-a18e-995666b24b3a tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e" status: 204 len: 0 microversion: 2.1 time: 0.252409 Feb 19 02:28:30.069005 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 185/376] 10.222.0.44 () {58 vars in 1229 bytes} [Fri Feb 19 02:28:29 2021] DELETE /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 02:28:30.080989 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-9ea74cf4-150c-41ee-b72e-ccf6b129ef59 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:30.081758 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-9ea74cf4-150c-41ee-b72e-ccf6b129ef59 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: c5a44231-8bb9-429c-8b52-046ccb23313e] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:30.090972 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9ea74cf4-150c-41ee-b72e-ccf6b129ef59 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:30.091513 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9ea74cf4-150c-41ee-b72e-ccf6b129ef59 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:30.092358 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9ea74cf4-150c-41ee-b72e-ccf6b129ef59 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:30.093330 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9ea74cf4-150c-41ee-b72e-ccf6b129ef59 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:30.301842 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ee458180-dcf9-4493-b563-0d594d85cb98 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:30.313173 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ee458180-dcf9-4493-b563-0d594d85cb98 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:30.314962 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ee458180-dcf9-4493-b563-0d594d85cb98 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:30.316290 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ee458180-dcf9-4493-b563-0d594d85cb98 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1738 microversion: 2.20 time: 0.301941 Feb 19 02:28:30.317291 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 192/377] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:30 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1738 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:28:30.352165 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9ea74cf4-150c-41ee-b72e-ccf6b129ef59 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5457e8bd9454f33a5f2c47221c8f018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b706884b7904a598558fe41d1d16d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:30.362003 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-9ea74cf4-150c-41ee-b72e-ccf6b129ef59 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "GET /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e" status: 200 len: 1502 microversion: 2.1 time: 0.287631 Feb 19 02:28:30.362670 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 186/378] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:30 2021] GET /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e => generated 1502 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:30.722548 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a7f32845-72b0-4e34-9f2a-add0ec35eaba tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:30.722548 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a7f32845-72b0-4e34-9f2a-add0ec35eaba tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:30.733043 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a7f32845-72b0-4e34-9f2a-add0ec35eaba tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:30.733558 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a7f32845-72b0-4e34-9f2a-add0ec35eaba tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:30.734546 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a7f32845-72b0-4e34-9f2a-add0ec35eaba tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:30.735039 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a7f32845-72b0-4e34-9f2a-add0ec35eaba tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:31.116241 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a7f32845-72b0-4e34-9f2a-add0ec35eaba tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:31.127302 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a7f32845-72b0-4e34-9f2a-add0ec35eaba tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1721 microversion: 2.1 time: 0.410747 Feb 19 02:28:31.128492 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 193/379] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:30 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1721 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:31.336593 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-fa7bbe30-b171-46db-95db-9d6678446915 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:31.338304 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-fa7bbe30-b171-46db-95db-9d6678446915 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:31.349236 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fa7bbe30-b171-46db-95db-9d6678446915 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:31.350165 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fa7bbe30-b171-46db-95db-9d6678446915 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:31.351238 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fa7bbe30-b171-46db-95db-9d6678446915 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:31.351922 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fa7bbe30-b171-46db-95db-9d6678446915 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:31.381400 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c4c3136f-7c26-4d54-a723-87588b160e5e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:31.382412 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c4c3136f-7c26-4d54-a723-87588b160e5e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: c5a44231-8bb9-429c-8b52-046ccb23313e] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:31.400606 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c4c3136f-7c26-4d54-a723-87588b160e5e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:31.401210 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c4c3136f-7c26-4d54-a723-87588b160e5e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:31.402153 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c4c3136f-7c26-4d54-a723-87588b160e5e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:31.407085 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c4c3136f-7c26-4d54-a723-87588b160e5e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:31.734085 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-fa7bbe30-b171-46db-95db-9d6678446915 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:31.745264 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-fa7bbe30-b171-46db-95db-9d6678446915 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:31.749520 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c4c3136f-7c26-4d54-a723-87588b160e5e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5457e8bd9454f33a5f2c47221c8f018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b706884b7904a598558fe41d1d16d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:31.754973 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-fa7bbe30-b171-46db-95db-9d6678446915 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:31.756343 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-fa7bbe30-b171-46db-95db-9d6678446915 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1738 microversion: 2.20 time: 0.423917 Feb 19 02:28:31.757081 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 187/380] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:31 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1738 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:28:31.773110 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c4c3136f-7c26-4d54-a723-87588b160e5e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "GET /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e" status: 200 len: 1502 microversion: 2.1 time: 0.395295 Feb 19 02:28:31.773776 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 194/381] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:31 2021] GET /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e => generated 1502 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:32.147471 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-deb2d43c-c0ab-4b50-bc3d-7d315f5a4e97 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:32.148792 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-deb2d43c-c0ab-4b50-bc3d-7d315f5a4e97 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:32.171967 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-deb2d43c-c0ab-4b50-bc3d-7d315f5a4e97 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:32.179164 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-deb2d43c-c0ab-4b50-bc3d-7d315f5a4e97 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:32.180517 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-deb2d43c-c0ab-4b50-bc3d-7d315f5a4e97 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:32.181172 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-deb2d43c-c0ab-4b50-bc3d-7d315f5a4e97 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:32.771258 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-deb2d43c-c0ab-4b50-bc3d-7d315f5a4e97 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:32.777288 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e1db2c92-b2b3-47de-87bc-e2b2776ee7db tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:32.777978 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e1db2c92-b2b3-47de-87bc-e2b2776ee7db tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:32.782231 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-deb2d43c-c0ab-4b50-bc3d-7d315f5a4e97 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1721 microversion: 2.1 time: 0.639018 Feb 19 02:28:32.783691 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 188/382] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:32 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1721 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:32.788165 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e1db2c92-b2b3-47de-87bc-e2b2776ee7db tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:32.791032 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e1db2c92-b2b3-47de-87bc-e2b2776ee7db tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:32.791979 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e1db2c92-b2b3-47de-87bc-e2b2776ee7db tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:32.792482 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e1db2c92-b2b3-47de-87bc-e2b2776ee7db tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:32.806917 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-fc13efbb-5b1a-44cd-a38a-8743ab39445e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:32.807820 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-fc13efbb-5b1a-44cd-a38a-8743ab39445e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: c5a44231-8bb9-429c-8b52-046ccb23313e] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:32.816648 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fc13efbb-5b1a-44cd-a38a-8743ab39445e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:32.817436 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fc13efbb-5b1a-44cd-a38a-8743ab39445e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:32.818641 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fc13efbb-5b1a-44cd-a38a-8743ab39445e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:32.819292 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fc13efbb-5b1a-44cd-a38a-8743ab39445e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:33.153273 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e1db2c92-b2b3-47de-87bc-e2b2776ee7db tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:33.174408 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e1db2c92-b2b3-47de-87bc-e2b2776ee7db tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:33.176399 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e1db2c92-b2b3-47de-87bc-e2b2776ee7db tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:33.182109 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e1db2c92-b2b3-47de-87bc-e2b2776ee7db tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1738 microversion: 2.20 time: 0.408929 Feb 19 02:28:33.182448 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 195/383] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:32 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1738 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:28:33.295678 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-fc13efbb-5b1a-44cd-a38a-8743ab39445e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5457e8bd9454f33a5f2c47221c8f018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b706884b7904a598558fe41d1d16d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:33.307627 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-fc13efbb-5b1a-44cd-a38a-8743ab39445e tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "GET /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e" status: 200 len: 1502 microversion: 2.1 time: 0.505199 Feb 19 02:28:33.318377 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 189/384] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:32 2021] GET /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e => generated 1502 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:28:33.648310 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-a9f3dd98-0e38-44bc-8af7-22f8d0ff28bc req-4ecd1faa-4c71-4f28-a855-7400e4811328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5a44231-8bb9-429c-8b52-046ccb23313e", "name": "network-vif-deleted", "tag": "3583108b-c257-4b21-bfc3-dbd6a990face"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:33.654170 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:28:33.654170 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:28:33.680063 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-a9f3dd98-0e38-44bc-8af7-22f8d0ff28bc req-4ecd1faa-4c71-4f28-a855-7400e4811328 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:33.681518 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-a9f3dd98-0e38-44bc-8af7-22f8d0ff28bc req-4ecd1faa-4c71-4f28-a855-7400e4811328 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:33.720218 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-a9f3dd98-0e38-44bc-8af7-22f8d0ff28bc req-4ecd1faa-4c71-4f28-a855-7400e4811328 service nova] Creating event network-vif-deleted:3583108b-c257-4b21-bfc3-dbd6a990face for instance c5a44231-8bb9-429c-8b52-046ccb23313e on hv-cinder-77642 Feb 19 02:28:33.736427 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-a9f3dd98-0e38-44bc-8af7-22f8d0ff28bc req-4ecd1faa-4c71-4f28-a855-7400e4811328 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090106 Feb 19 02:28:33.739405 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 196/385] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:28:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:28:33.808659 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-3188b00b-adfe-4d2b-84cf-8dd14cf89df4 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:33.809343 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-3188b00b-adfe-4d2b-84cf-8dd14cf89df4 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:33.835578 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3188b00b-adfe-4d2b-84cf-8dd14cf89df4 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:33.836322 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3188b00b-adfe-4d2b-84cf-8dd14cf89df4 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:33.838496 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3188b00b-adfe-4d2b-84cf-8dd14cf89df4 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:33.839194 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3188b00b-adfe-4d2b-84cf-8dd14cf89df4 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:34.141908 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-3188b00b-adfe-4d2b-84cf-8dd14cf89df4 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:34.157728 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-3188b00b-adfe-4d2b-84cf-8dd14cf89df4 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1721 microversion: 2.1 time: 0.354291 Feb 19 02:28:34.158390 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 190/386] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:33 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1721 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:34.202617 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4715f4ad-2727-41a4-be66-4df18e0a491e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:34.203392 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-4715f4ad-2727-41a4-be66-4df18e0a491e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:34.213626 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4715f4ad-2727-41a4-be66-4df18e0a491e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:34.214143 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4715f4ad-2727-41a4-be66-4df18e0a491e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:34.215038 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4715f4ad-2727-41a4-be66-4df18e0a491e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:34.215533 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4715f4ad-2727-41a4-be66-4df18e0a491e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:34.361098 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d0c2da41-c144-4136-995e-fb7ddf555754 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:34.362579 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d0c2da41-c144-4136-995e-fb7ddf555754 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: c5a44231-8bb9-429c-8b52-046ccb23313e] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:34.382086 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d0c2da41-c144-4136-995e-fb7ddf555754 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:34.382628 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d0c2da41-c144-4136-995e-fb7ddf555754 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:34.383953 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d0c2da41-c144-4136-995e-fb7ddf555754 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:34.383953 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d0c2da41-c144-4136-995e-fb7ddf555754 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:34.486761 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d0c2da41-c144-4136-995e-fb7ddf555754 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:34.487483 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d0c2da41-c144-4136-995e-fb7ddf555754 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:34.488150 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.objects.instance [None req-d0c2da41-c144-4136-995e-fb7ddf555754 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lazy-loading 'fault' on Instance uuid c5a44231-8bb9-429c-8b52-046ccb23313e {{(pid=98194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 02:28:34.499987 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-4715f4ad-2727-41a4-be66-4df18e0a491e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:34.512380 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-4715f4ad-2727-41a4-be66-4df18e0a491e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:34.515049 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-4715f4ad-2727-41a4-be66-4df18e0a491e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:34.516457 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-4715f4ad-2727-41a4-be66-4df18e0a491e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1738 microversion: 2.20 time: 0.318859 Feb 19 02:28:34.517944 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 197/387] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:34 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1738 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:28:34.591451 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-d0c2da41-c144-4136-995e-fb7ddf555754 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5457e8bd9454f33a5f2c47221c8f018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b706884b7904a598558fe41d1d16d26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:34.606149 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d0c2da41-c144-4136-995e-fb7ddf555754 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "GET /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e" status: 200 len: 1304 microversion: 2.1 time: 0.249741 Feb 19 02:28:34.620474 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 191/388] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:34 2021] GET /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e => generated 1304 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:35.179021 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-daf465bb-3373-4c7d-a762-35c287c67a68 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:35.180290 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-daf465bb-3373-4c7d-a762-35c287c67a68 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:35.194178 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-daf465bb-3373-4c7d-a762-35c287c67a68 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:35.195196 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-daf465bb-3373-4c7d-a762-35c287c67a68 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:35.196600 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-daf465bb-3373-4c7d-a762-35c287c67a68 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:35.197716 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-daf465bb-3373-4c7d-a762-35c287c67a68 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:35.466465 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-daf465bb-3373-4c7d-a762-35c287c67a68 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:35.478436 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-daf465bb-3373-4c7d-a762-35c287c67a68 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1721 microversion: 2.1 time: 0.305406 Feb 19 02:28:35.479336 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 198/389] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:35 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1721 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:35.537847 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-2cffd06c-2405-42dc-a999-dec96fb6a5dd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:35.539164 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-2cffd06c-2405-42dc-a999-dec96fb6a5dd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:35.548575 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2cffd06c-2405-42dc-a999-dec96fb6a5dd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:35.549441 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2cffd06c-2405-42dc-a999-dec96fb6a5dd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:35.550591 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2cffd06c-2405-42dc-a999-dec96fb6a5dd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:35.551321 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2cffd06c-2405-42dc-a999-dec96fb6a5dd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:35.625061 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-196fc07e-c680-40a6-8c3d-984c22f15009 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:35.626242 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-196fc07e-c680-40a6-8c3d-984c22f15009 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] [instance: c5a44231-8bb9-429c-8b52-046ccb23313e] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:35.640268 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-196fc07e-c680-40a6-8c3d-984c22f15009 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:35.642377 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-196fc07e-c680-40a6-8c3d-984c22f15009 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:35.643366 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-196fc07e-c680-40a6-8c3d-984c22f15009 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:35.644093 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-196fc07e-c680-40a6-8c3d-984c22f15009 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:35.710457 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-196fc07e-c680-40a6-8c3d-984c22f15009 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] HTTP exception thrown: Instance c5a44231-8bb9-429c-8b52-046ccb23313e could not be found. Feb 19 02:28:35.711444 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-196fc07e-c680-40a6-8c3d-984c22f15009 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] Returning 404 to user: Instance c5a44231-8bb9-429c-8b52-046ccb23313e could not be found. {{(pid=98193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:28:35.713295 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-196fc07e-c680-40a6-8c3d-984c22f15009 tempest-VolumesActionsTest-613696298 tempest-VolumesActionsTest-613696298-project] 10.222.0.44 "GET /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e" status: 404 len: 111 microversion: 2.1 time: 0.092320 Feb 19 02:28:35.714456 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 199/390] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:35 2021] GET /compute/v2.1/servers/c5a44231-8bb9-429c-8b52-046ccb23313e => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 02:28:35.793825 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-2cffd06c-2405-42dc-a999-dec96fb6a5dd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:35.804937 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-2cffd06c-2405-42dc-a999-dec96fb6a5dd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:35.807322 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-2cffd06c-2405-42dc-a999-dec96fb6a5dd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:35.808708 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-2cffd06c-2405-42dc-a999-dec96fb6a5dd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1738 microversion: 2.20 time: 0.275309 Feb 19 02:28:35.809476 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 192/391] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:35 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1738 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:28:36.236741 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-16038c0d-bda0-491d-b33a-174860ba0356 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:36.238022 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-16038c0d-bda0-491d-b33a-174860ba0356 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:36.263194 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-16038c0d-bda0-491d-b33a-174860ba0356 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:36.263733 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-16038c0d-bda0-491d-b33a-174860ba0356 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:36.264573 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-16038c0d-bda0-491d-b33a-174860ba0356 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:36.265068 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-16038c0d-bda0-491d-b33a-174860ba0356 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:36.394908 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-fb136c1f-80b7-48a6-843e-b21f62248fdc tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-545652366", "imageRef": "37a0f9d8-d3f7-417e-bce6-371e41a47c88", "flavorRef": "452"}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:36.433477 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.objects.instance [None req-16038c0d-bda0-491d-b33a-174860ba0356 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lazy-loading 'flavor' on Instance uuid c0a55cfa-c2c0-48e5-b519-53c9b68c38cd {{(pid=98193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 02:28:36.545653 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-fb136c1f-80b7-48a6-843e-b21f62248fdc tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] validate_networks() for None {{(pid=98194) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 02:28:36.799887 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-16038c0d-bda0-491d-b33a-174860ba0356 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "POST /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd/action" status: 200 len: 32 microversion: 2.1 time: 0.566605 Feb 19 02:28:36.800828 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 200/392] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:28:36 2021] POST /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd/action => generated 32 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:28:36.816333 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-56523f84-589c-460e-8e2f-20b41f2e34b6 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:36.817123 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-56523f84-589c-460e-8e2f-20b41f2e34b6 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:36.828957 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-56523f84-589c-460e-8e2f-20b41f2e34b6 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:36.829756 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-56523f84-589c-460e-8e2f-20b41f2e34b6 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:36.830706 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-56523f84-589c-460e-8e2f-20b41f2e34b6 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:36.831210 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-56523f84-589c-460e-8e2f-20b41f2e34b6 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:37.122803 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-56523f84-589c-460e-8e2f-20b41f2e34b6 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:37.139761 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-56523f84-589c-460e-8e2f-20b41f2e34b6 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1721 microversion: 2.1 time: 0.331941 Feb 19 02:28:37.140534 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 201/393] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:36 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1721 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:37.146119 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e646a260-23f5-4042-983d-5bd5c8dd4004 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:37.146918 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e646a260-23f5-4042-983d-5bd5c8dd4004 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:37.156797 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e646a260-23f5-4042-983d-5bd5c8dd4004 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:37.157413 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e646a260-23f5-4042-983d-5bd5c8dd4004 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:37.158555 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e646a260-23f5-4042-983d-5bd5c8dd4004 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:37.159777 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e646a260-23f5-4042-983d-5bd5c8dd4004 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:37.296674 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-fb136c1f-80b7-48a6-843e-b21f62248fdc tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Flavor limits 0:0:0 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 02:28:37.297218 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-fb136c1f-80b7-48a6-843e-b21f62248fdc tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Image limits 0:0:0 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 02:28:37.297665 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-fb136c1f-80b7-48a6-843e-b21f62248fdc tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Flavor pref 0:0:0 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 02:28:37.298278 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-fb136c1f-80b7-48a6-843e-b21f62248fdc tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Image pref 0:0:0 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 02:28:37.298618 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-fb136c1f-80b7-48a6-843e-b21f62248fdc tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 02:28:37.312248 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fb136c1f-80b7-48a6-843e-b21f62248fdc tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:37.312765 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fb136c1f-80b7-48a6-843e-b21f62248fdc tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:37.313644 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fb136c1f-80b7-48a6-843e-b21f62248fdc tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:37.314119 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fb136c1f-80b7-48a6-843e-b21f62248fdc tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:37.359702 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-fb136c1f-80b7-48a6-843e-b21f62248fdc tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Getting quotas for project c43e163eccb44a118e6b89d19bdb5064. Resources: {'ram', 'instances', 'cores'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:28:37.364954 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-fb136c1f-80b7-48a6-843e-b21f62248fdc tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Getting quotas for user 593583d805ba40fe83595018ada8b386 and project c43e163eccb44a118e6b89d19bdb5064. Resources: {'ram', 'instances', 'cores'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:28:37.379348 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-fb136c1f-80b7-48a6-843e-b21f62248fdc tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Going to run 1 instances... {{(pid=98194) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 02:28:37.382310 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-fb136c1f-80b7-48a6-843e-b21f62248fdc tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] [instance: 87114f5c-f2da-4496-9d54-2eb9c3d28916] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37a0f9d8-d3f7-417e-bce6-371e41a47c88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 02:28:37.439958 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-fb136c1f-80b7-48a6-843e-b21f62248fdc tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.048900 Feb 19 02:28:37.440983 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 193/394] 10.222.0.44 () {60 vars in 1137 bytes} [Fri Feb 19 02:28:36 2021] POST /compute/v2.1/servers => generated 380 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 02:28:37.445942 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c2607f36-25b1-49bf-aec8-d4bbc5d32148 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:37.447785 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c2607f36-25b1-49bf-aec8-d4bbc5d32148 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:37.457092 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c2607f36-25b1-49bf-aec8-d4bbc5d32148 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:37.457859 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c2607f36-25b1-49bf-aec8-d4bbc5d32148 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:37.458920 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c2607f36-25b1-49bf-aec8-d4bbc5d32148 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:37.459563 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c2607f36-25b1-49bf-aec8-d4bbc5d32148 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:37.518694 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e646a260-23f5-4042-983d-5bd5c8dd4004 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:37.537653 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e646a260-23f5-4042-983d-5bd5c8dd4004 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1568 microversion: 2.1 time: 0.395833 Feb 19 02:28:37.538327 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 202/395] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:37 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1568 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:37.574419 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ac1a49f2-bb28-41bc-93f9-b7df2366b227 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:37.575084 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ac1a49f2-bb28-41bc-93f9-b7df2366b227 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] [instance: 87114f5c-f2da-4496-9d54-2eb9c3d28916] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:37.675449 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ac1a49f2-bb28-41bc-93f9-b7df2366b227 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593583d805ba40fe83595018ada8b386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43e163eccb44a118e6b89d19bdb5064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:37.693664 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ac1a49f2-bb28-41bc-93f9-b7df2366b227 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] 10.222.0.44 "GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916" status: 200 len: 1214 microversion: 2.1 time: 0.154101 Feb 19 02:28:37.694643 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 203/396] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:37 2021] GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916 => generated 1214 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:38.173875 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-edb7f0f2-a45c-4f3e-a95f-448723632740 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:38.174646 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-edb7f0f2-a45c-4f3e-a95f-448723632740 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:38.191697 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-edb7f0f2-a45c-4f3e-a95f-448723632740 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:38.192526 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-edb7f0f2-a45c-4f3e-a95f-448723632740 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:38.193753 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-edb7f0f2-a45c-4f3e-a95f-448723632740 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:38.194520 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-edb7f0f2-a45c-4f3e-a95f-448723632740 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:38.343437 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c2607f36-25b1-49bf-aec8-d4bbc5d32148 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:38.355949 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c2607f36-25b1-49bf-aec8-d4bbc5d32148 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:38.357805 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c2607f36-25b1-49bf-aec8-d4bbc5d32148 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:38.359590 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c2607f36-25b1-49bf-aec8-d4bbc5d32148 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1738 microversion: 2.20 time: 0.917409 Feb 19 02:28:38.360460 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 194/397] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:37 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1738 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:28:38.462794 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-edb7f0f2-a45c-4f3e-a95f-448723632740 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:38.473322 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-edb7f0f2-a45c-4f3e-a95f-448723632740 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1721 microversion: 2.1 time: 0.303850 Feb 19 02:28:38.474309 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 204/398] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:38 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1721 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:38.573384 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c447a280-da72-4fec-aecc-76382d86b4b2 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:38.574197 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c447a280-da72-4fec-aecc-76382d86b4b2 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:38.584964 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c447a280-da72-4fec-aecc-76382d86b4b2 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:38.584964 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c447a280-da72-4fec-aecc-76382d86b4b2 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:38.585567 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c447a280-da72-4fec-aecc-76382d86b4b2 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:38.585910 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c447a280-da72-4fec-aecc-76382d86b4b2 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:38.713674 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-dcd6f112-c2af-4f8c-8579-4006dfacbd81 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:38.714434 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-dcd6f112-c2af-4f8c-8579-4006dfacbd81 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] [instance: 87114f5c-f2da-4496-9d54-2eb9c3d28916] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:38.727475 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dcd6f112-c2af-4f8c-8579-4006dfacbd81 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:38.728001 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dcd6f112-c2af-4f8c-8579-4006dfacbd81 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:38.728866 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dcd6f112-c2af-4f8c-8579-4006dfacbd81 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:38.729367 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dcd6f112-c2af-4f8c-8579-4006dfacbd81 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:38.851434 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c447a280-da72-4fec-aecc-76382d86b4b2 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:38.861625 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c447a280-da72-4fec-aecc-76382d86b4b2 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1568 microversion: 2.1 time: 0.293116 Feb 19 02:28:38.862243 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 195/399] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:38 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1568 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:38.885489 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-dcd6f112-c2af-4f8c-8579-4006dfacbd81 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593583d805ba40fe83595018ada8b386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43e163eccb44a118e6b89d19bdb5064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:38.897099 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-dcd6f112-c2af-4f8c-8579-4006dfacbd81 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] 10.222.0.44 "GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916" status: 200 len: 1210 microversion: 2.1 time: 0.187639 Feb 19 02:28:38.898535 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 205/400] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:38 2021] GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916 => generated 1210 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:39.380814 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-6b5729b2-8018-452c-8b72-363857349eb5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:39.381523 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-6b5729b2-8018-452c-8b72-363857349eb5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:39.390557 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6b5729b2-8018-452c-8b72-363857349eb5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:39.391203 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6b5729b2-8018-452c-8b72-363857349eb5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:39.392051 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6b5729b2-8018-452c-8b72-363857349eb5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:39.392565 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6b5729b2-8018-452c-8b72-363857349eb5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:39.493830 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-2ff58a15-8e87-4aa7-a27f-2423fa44a460 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:39.494518 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-2ff58a15-8e87-4aa7-a27f-2423fa44a460 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:39.502756 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2ff58a15-8e87-4aa7-a27f-2423fa44a460 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:39.503261 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2ff58a15-8e87-4aa7-a27f-2423fa44a460 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:39.504099 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2ff58a15-8e87-4aa7-a27f-2423fa44a460 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:39.504585 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2ff58a15-8e87-4aa7-a27f-2423fa44a460 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:39.619202 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-6b5729b2-8018-452c-8b72-363857349eb5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:39.629047 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-6b5729b2-8018-452c-8b72-363857349eb5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:39.630648 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-6b5729b2-8018-452c-8b72-363857349eb5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:39.631888 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-6b5729b2-8018-452c-8b72-363857349eb5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1738 microversion: 2.20 time: 0.255849 Feb 19 02:28:39.632501 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 196/401] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:39 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1738 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:28:39.858774 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-2ff58a15-8e87-4aa7-a27f-2423fa44a460 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:39.868327 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-2ff58a15-8e87-4aa7-a27f-2423fa44a460 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1721 microversion: 2.1 time: 0.378941 Feb 19 02:28:39.868866 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 206/402] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:39 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1721 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:28:39.881685 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-78d6a149-7dec-4fef-84ad-44d6080a2204 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:39.882342 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-78d6a149-7dec-4fef-84ad-44d6080a2204 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:39.890911 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-78d6a149-7dec-4fef-84ad-44d6080a2204 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:39.891409 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-78d6a149-7dec-4fef-84ad-44d6080a2204 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:39.892231 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-78d6a149-7dec-4fef-84ad-44d6080a2204 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:39.892717 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-78d6a149-7dec-4fef-84ad-44d6080a2204 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:39.925790 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4e751593-58b2-41b0-91ef-7340e9651307 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:39.926483 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-4e751593-58b2-41b0-91ef-7340e9651307 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] [instance: 87114f5c-f2da-4496-9d54-2eb9c3d28916] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:39.936585 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4e751593-58b2-41b0-91ef-7340e9651307 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:39.937092 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4e751593-58b2-41b0-91ef-7340e9651307 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:39.937941 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4e751593-58b2-41b0-91ef-7340e9651307 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:39.938526 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4e751593-58b2-41b0-91ef-7340e9651307 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:40.066164 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-4e751593-58b2-41b0-91ef-7340e9651307 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593583d805ba40fe83595018ada8b386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43e163eccb44a118e6b89d19bdb5064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:40.076109 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-4e751593-58b2-41b0-91ef-7340e9651307 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] 10.222.0.44 "GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916" status: 200 len: 1210 microversion: 2.1 time: 0.153925 Feb 19 02:28:40.076880 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 207/403] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:39 2021] GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916 => generated 1210 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:40.125145 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-78d6a149-7dec-4fef-84ad-44d6080a2204 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:40.139484 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-78d6a149-7dec-4fef-84ad-44d6080a2204 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1568 microversion: 2.1 time: 0.261816 Feb 19 02:28:40.140125 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 197/404] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:39 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1568 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:40.653256 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1f4c73f3-b36f-4422-b0ec-2817c02f791d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:40.654087 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1f4c73f3-b36f-4422-b0ec-2817c02f791d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:40.662240 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1f4c73f3-b36f-4422-b0ec-2817c02f791d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:40.662788 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1f4c73f3-b36f-4422-b0ec-2817c02f791d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:40.663617 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1f4c73f3-b36f-4422-b0ec-2817c02f791d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:40.664104 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1f4c73f3-b36f-4422-b0ec-2817c02f791d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:40.887493 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a9a7cc47-54fd-4535-a108-758e32bf4e7e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:40.888166 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a9a7cc47-54fd-4535-a108-758e32bf4e7e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:40.896391 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a9a7cc47-54fd-4535-a108-758e32bf4e7e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:40.896911 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a9a7cc47-54fd-4535-a108-758e32bf4e7e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:40.897817 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a9a7cc47-54fd-4535-a108-758e32bf4e7e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:40.898427 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a9a7cc47-54fd-4535-a108-758e32bf4e7e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:40.926225 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-1f4c73f3-b36f-4422-b0ec-2817c02f791d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:40.936518 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-1f4c73f3-b36f-4422-b0ec-2817c02f791d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:40.938103 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-1f4c73f3-b36f-4422-b0ec-2817c02f791d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:40.939360 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1f4c73f3-b36f-4422-b0ec-2817c02f791d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1738 microversion: 2.20 time: 0.290991 Feb 19 02:28:40.940278 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 208/405] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:40 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1738 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:28:41.095037 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e0f0506a-51ff-4eba-9604-a861fb648d3c tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:41.095708 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e0f0506a-51ff-4eba-9604-a861fb648d3c tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] [instance: 87114f5c-f2da-4496-9d54-2eb9c3d28916] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:41.103582 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e0f0506a-51ff-4eba-9604-a861fb648d3c tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:41.104098 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e0f0506a-51ff-4eba-9604-a861fb648d3c tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:41.104943 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e0f0506a-51ff-4eba-9604-a861fb648d3c tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:41.105439 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e0f0506a-51ff-4eba-9604-a861fb648d3c tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:41.115166 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a9a7cc47-54fd-4535-a108-758e32bf4e7e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:41.125526 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a9a7cc47-54fd-4535-a108-758e32bf4e7e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1721 microversion: 2.1 time: 0.242045 Feb 19 02:28:41.126391 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 198/406] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:40 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1721 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:28:41.159531 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-98046bc3-e564-4d1d-be35-c3cfb1256a19 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:41.160561 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-98046bc3-e564-4d1d-be35-c3cfb1256a19 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:41.169854 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-98046bc3-e564-4d1d-be35-c3cfb1256a19 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:41.169854 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-98046bc3-e564-4d1d-be35-c3cfb1256a19 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:41.170789 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-98046bc3-e564-4d1d-be35-c3cfb1256a19 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:41.171376 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-98046bc3-e564-4d1d-be35-c3cfb1256a19 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:41.243694 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e0f0506a-51ff-4eba-9604-a861fb648d3c tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593583d805ba40fe83595018ada8b386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43e163eccb44a118e6b89d19bdb5064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:41.253757 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e0f0506a-51ff-4eba-9604-a861fb648d3c tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] 10.222.0.44 "GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916" status: 200 len: 1210 microversion: 2.1 time: 0.162724 Feb 19 02:28:41.254421 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 209/407] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:41 2021] GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916 => generated 1210 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:28:41.394749 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-98046bc3-e564-4d1d-be35-c3cfb1256a19 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:41.404845 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-98046bc3-e564-4d1d-be35-c3cfb1256a19 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1568 microversion: 2.1 time: 0.249193 Feb 19 02:28:41.405663 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 199/408] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:41 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1568 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:41.959648 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b81d8881-e5be-4456-9e8c-98d0a256b837 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:41.960536 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b81d8881-e5be-4456-9e8c-98d0a256b837 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:41.971872 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b81d8881-e5be-4456-9e8c-98d0a256b837 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:41.972392 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b81d8881-e5be-4456-9e8c-98d0a256b837 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:41.973255 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b81d8881-e5be-4456-9e8c-98d0a256b837 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:41.973750 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b81d8881-e5be-4456-9e8c-98d0a256b837 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:42.148275 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f7897576-9126-4d82-9958-4a60b7c1b38c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:42.148961 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f7897576-9126-4d82-9958-4a60b7c1b38c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:42.157267 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f7897576-9126-4d82-9958-4a60b7c1b38c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:42.157799 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f7897576-9126-4d82-9958-4a60b7c1b38c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:42.158661 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f7897576-9126-4d82-9958-4a60b7c1b38c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:42.159175 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f7897576-9126-4d82-9958-4a60b7c1b38c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:42.195622 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b81d8881-e5be-4456-9e8c-98d0a256b837 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:42.207716 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b81d8881-e5be-4456-9e8c-98d0a256b837 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:42.209709 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b81d8881-e5be-4456-9e8c-98d0a256b837 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:42.210952 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b81d8881-e5be-4456-9e8c-98d0a256b837 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1738 microversion: 2.20 time: 0.255453 Feb 19 02:28:42.215063 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 210/409] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:41 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1738 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:28:42.280571 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-689d7a9a-74d6-4f3a-867b-762bcd21c9da tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:42.281698 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-689d7a9a-74d6-4f3a-867b-762bcd21c9da tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] [instance: 87114f5c-f2da-4496-9d54-2eb9c3d28916] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:42.292139 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-689d7a9a-74d6-4f3a-867b-762bcd21c9da tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:42.292798 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-689d7a9a-74d6-4f3a-867b-762bcd21c9da tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:42.293806 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-689d7a9a-74d6-4f3a-867b-762bcd21c9da tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:42.294536 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-689d7a9a-74d6-4f3a-867b-762bcd21c9da tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:42.400348 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f7897576-9126-4d82-9958-4a60b7c1b38c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:42.410593 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f7897576-9126-4d82-9958-4a60b7c1b38c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1721 microversion: 2.1 time: 0.269428 Feb 19 02:28:42.411224 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 200/410] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:42 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1721 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:42.423688 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-68bc2111-b3bf-4a56-9f3d-f4badd36441b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:42.424426 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-68bc2111-b3bf-4a56-9f3d-f4badd36441b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:42.434815 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-68bc2111-b3bf-4a56-9f3d-f4badd36441b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:42.435784 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-68bc2111-b3bf-4a56-9f3d-f4badd36441b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:42.437090 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-68bc2111-b3bf-4a56-9f3d-f4badd36441b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:42.437702 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-68bc2111-b3bf-4a56-9f3d-f4badd36441b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:42.440321 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-689d7a9a-74d6-4f3a-867b-762bcd21c9da tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593583d805ba40fe83595018ada8b386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43e163eccb44a118e6b89d19bdb5064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:42.459395 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-689d7a9a-74d6-4f3a-867b-762bcd21c9da tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] 10.222.0.44 "GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916" status: 200 len: 1266 microversion: 2.1 time: 0.184472 Feb 19 02:28:42.460445 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 211/411] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:42 2021] GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:28:42.911329 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-68bc2111-b3bf-4a56-9f3d-f4badd36441b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:42.938329 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-68bc2111-b3bf-4a56-9f3d-f4badd36441b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1568 microversion: 2.1 time: 0.513225 Feb 19 02:28:42.949408 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 201/412] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:42 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1568 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:43.231420 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-87ea2b30-418c-4a63-b165-e51f29abd9a9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:43.232260 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-87ea2b30-418c-4a63-b165-e51f29abd9a9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:43.248917 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-87ea2b30-418c-4a63-b165-e51f29abd9a9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:43.249554 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-87ea2b30-418c-4a63-b165-e51f29abd9a9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:43.250895 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-87ea2b30-418c-4a63-b165-e51f29abd9a9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:43.251661 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-87ea2b30-418c-4a63-b165-e51f29abd9a9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:43.429325 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-087ca1cc-b226-435d-978c-1e785100607f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:43.430183 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-087ca1cc-b226-435d-978c-1e785100607f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:43.448702 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-087ca1cc-b226-435d-978c-1e785100607f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:43.451629 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-087ca1cc-b226-435d-978c-1e785100607f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:43.454866 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-087ca1cc-b226-435d-978c-1e785100607f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:43.464873 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-087ca1cc-b226-435d-978c-1e785100607f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:43.661390 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-87ea2b30-418c-4a63-b165-e51f29abd9a9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:43.678289 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-87ea2b30-418c-4a63-b165-e51f29abd9a9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:43.683945 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-87ea2b30-418c-4a63-b165-e51f29abd9a9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:43.694198 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-87ea2b30-418c-4a63-b165-e51f29abd9a9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1720 microversion: 2.20 time: 0.466808 Feb 19 02:28:43.695405 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 212/413] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:43 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1720 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:28:43.701942 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-66a16590-652e-477c-93aa-eb27ca5eec83 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:43.707469 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-66a16590-652e-477c-93aa-eb27ca5eec83 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] [instance: 87114f5c-f2da-4496-9d54-2eb9c3d28916] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:43.732094 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-66a16590-652e-477c-93aa-eb27ca5eec83 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:43.736922 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-66a16590-652e-477c-93aa-eb27ca5eec83 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:43.738261 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-66a16590-652e-477c-93aa-eb27ca5eec83 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:43.738944 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-66a16590-652e-477c-93aa-eb27ca5eec83 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:43.956546 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-66a16590-652e-477c-93aa-eb27ca5eec83 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593583d805ba40fe83595018ada8b386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43e163eccb44a118e6b89d19bdb5064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:43.966922 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-66a16590-652e-477c-93aa-eb27ca5eec83 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] 10.222.0.44 "GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916" status: 200 len: 1272 microversion: 2.1 time: 0.269910 Feb 19 02:28:43.978487 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 213/414] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:43 2021] GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916 => generated 1272 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:43.984793 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-40498cf5-9102-44ed-8d9a-5fb6926c9a3a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:43.985172 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-40498cf5-9102-44ed-8d9a-5fb6926c9a3a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f5b5f904-128e-4b00-b03a-3433a0a0e7fb] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:43.994040 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-40498cf5-9102-44ed-8d9a-5fb6926c9a3a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:43.994887 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-087ca1cc-b226-435d-978c-1e785100607f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:43.995517 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-40498cf5-9102-44ed-8d9a-5fb6926c9a3a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:43.996496 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-40498cf5-9102-44ed-8d9a-5fb6926c9a3a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:43.997100 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-40498cf5-9102-44ed-8d9a-5fb6926c9a3a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:44.007019 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-087ca1cc-b226-435d-978c-1e785100607f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1721 microversion: 2.1 time: 0.581645 Feb 19 02:28:44.022955 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 202/415] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:43 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1721 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:44.029523 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-871975d8-b82d-4457-829b-010ea24dc8a0 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:44.030618 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-871975d8-b82d-4457-829b-010ea24dc8a0 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:44.042850 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-871975d8-b82d-4457-829b-010ea24dc8a0 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:44.043570 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-871975d8-b82d-4457-829b-010ea24dc8a0 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:44.044751 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-871975d8-b82d-4457-829b-010ea24dc8a0 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:44.045394 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-871975d8-b82d-4457-829b-010ea24dc8a0 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:44.227233 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.objects.instance [None req-40498cf5-9102-44ed-8d9a-5fb6926c9a3a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lazy-loading 'services' on Instance uuid f5b5f904-128e-4b00-b03a-3433a0a0e7fb {{(pid=98193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 02:28:44.512986 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-40498cf5-9102-44ed-8d9a-5fb6926c9a3a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb/os-volume_attachments/caaafd9a-0ac7-420f-930d-50259d1ec945" status: 202 len: 0 microversion: 2.1 time: 0.532140 Feb 19 02:28:44.523075 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 214/416] 10.222.0.44 () {58 vars in 1406 bytes} [Fri Feb 19 02:28:43 2021] DELETE /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb/os-volume_attachments/caaafd9a-0ac7-420f-930d-50259d1ec945 => generated 0 bytes in 539 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:28:44.563414 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-871975d8-b82d-4457-829b-010ea24dc8a0 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:44.578717 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-871975d8-b82d-4457-829b-010ea24dc8a0 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1568 microversion: 2.1 time: 0.554156 Feb 19 02:28:44.580853 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 203/417] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:44 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1568 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:44.716488 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7fe17296-9bd6-4f7a-ac09-3499085f8aae tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:44.717340 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7fe17296-9bd6-4f7a-ac09-3499085f8aae tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:44.733548 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7fe17296-9bd6-4f7a-ac09-3499085f8aae tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:44.734104 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7fe17296-9bd6-4f7a-ac09-3499085f8aae tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:44.735034 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7fe17296-9bd6-4f7a-ac09-3499085f8aae tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:44.735530 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7fe17296-9bd6-4f7a-ac09-3499085f8aae tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:44.985472 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-889b94b3-12f4-4b26-9cfe-00166c31fc9e tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:44.986433 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-889b94b3-12f4-4b26-9cfe-00166c31fc9e tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] [instance: 87114f5c-f2da-4496-9d54-2eb9c3d28916] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:45.002633 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-889b94b3-12f4-4b26-9cfe-00166c31fc9e tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:45.006328 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-889b94b3-12f4-4b26-9cfe-00166c31fc9e tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:45.007426 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-889b94b3-12f4-4b26-9cfe-00166c31fc9e tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:45.011641 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-889b94b3-12f4-4b26-9cfe-00166c31fc9e tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:45.122299 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7fe17296-9bd6-4f7a-ac09-3499085f8aae tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:45.135278 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7fe17296-9bd6-4f7a-ac09-3499085f8aae tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:45.137209 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7fe17296-9bd6-4f7a-ac09-3499085f8aae tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:45.138934 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7fe17296-9bd6-4f7a-ac09-3499085f8aae tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1720 microversion: 2.20 time: 0.427452 Feb 19 02:28:45.140089 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 215/418] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:44 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1720 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:28:45.146046 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a0e75dd5-87e8-4068-81e1-eac2776dbac7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:45.147068 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a0e75dd5-87e8-4068-81e1-eac2776dbac7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:45.156920 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a0e75dd5-87e8-4068-81e1-eac2776dbac7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:45.157760 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a0e75dd5-87e8-4068-81e1-eac2776dbac7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:45.158900 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a0e75dd5-87e8-4068-81e1-eac2776dbac7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:45.159610 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a0e75dd5-87e8-4068-81e1-eac2776dbac7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:45.467609 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a0e75dd5-87e8-4068-81e1-eac2776dbac7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:45.478417 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a0e75dd5-87e8-4068-81e1-eac2776dbac7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1721 microversion: 2.1 time: 0.336829 Feb 19 02:28:45.479261 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 216/419] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:45 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1721 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:45.600276 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-046ab3be-0ba9-4a3f-aec1-531bd83b962d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:45.601802 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-046ab3be-0ba9-4a3f-aec1-531bd83b962d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:45.612249 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-046ab3be-0ba9-4a3f-aec1-531bd83b962d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:45.613259 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-046ab3be-0ba9-4a3f-aec1-531bd83b962d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:45.614841 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-046ab3be-0ba9-4a3f-aec1-531bd83b962d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:45.615923 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-046ab3be-0ba9-4a3f-aec1-531bd83b962d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:45.980366 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-889b94b3-12f4-4b26-9cfe-00166c31fc9e tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593583d805ba40fe83595018ada8b386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43e163eccb44a118e6b89d19bdb5064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:46.009661 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-889b94b3-12f4-4b26-9cfe-00166c31fc9e tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] 10.222.0.44 "GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916" status: 200 len: 1314 microversion: 2.1 time: 1.026411 Feb 19 02:28:46.015228 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 204/420] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:44 2021] GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916 => generated 1314 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:46.078248 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-046ab3be-0ba9-4a3f-aec1-531bd83b962d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:46.087465 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-046ab3be-0ba9-4a3f-aec1-531bd83b962d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1568 microversion: 2.1 time: 0.491466 Feb 19 02:28:46.098170 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 217/421] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:45 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1568 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:46.162428 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8998359e-d3fb-4254-8901-b4697dd3b598 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:46.164058 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8998359e-d3fb-4254-8901-b4697dd3b598 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:46.188896 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8998359e-d3fb-4254-8901-b4697dd3b598 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:46.189433 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8998359e-d3fb-4254-8901-b4697dd3b598 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:46.190471 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8998359e-d3fb-4254-8901-b4697dd3b598 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:46.195506 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8998359e-d3fb-4254-8901-b4697dd3b598 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:46.497060 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7e4c2364-f1f5-4cf5-989c-db86489b69fe tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:46.498268 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7e4c2364-f1f5-4cf5-989c-db86489b69fe tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:46.514245 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7e4c2364-f1f5-4cf5-989c-db86489b69fe tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:46.518467 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7e4c2364-f1f5-4cf5-989c-db86489b69fe tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:46.519550 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7e4c2364-f1f5-4cf5-989c-db86489b69fe tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:46.520236 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7e4c2364-f1f5-4cf5-989c-db86489b69fe tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:46.780074 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7e4c2364-f1f5-4cf5-989c-db86489b69fe tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:46.791179 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7e4c2364-f1f5-4cf5-989c-db86489b69fe tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1721 microversion: 2.1 time: 0.298139 Feb 19 02:28:46.792090 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 218/422] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:46 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1721 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:46.808994 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8998359e-d3fb-4254-8901-b4697dd3b598 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:46.829044 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8998359e-d3fb-4254-8901-b4697dd3b598 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:46.834242 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8998359e-d3fb-4254-8901-b4697dd3b598 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:46.838208 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8998359e-d3fb-4254-8901-b4697dd3b598 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1723 microversion: 2.20 time: 0.681443 Feb 19 02:28:46.839470 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 205/423] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:46 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1723 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:28:46.856792 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-38e3e554-e0ef-4850-848b-e7a9201807ac req-0591d6e6-0505-44aa-b49c-8066195c2632 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87114f5c-f2da-4496-9d54-2eb9c3d28916", "tag": "f816b76e-b1f2-4310-aa5d-8e11af558a98"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:46.859123 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:28:46.859123 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:28:46.868325 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-38e3e554-e0ef-4850-848b-e7a9201807ac req-0591d6e6-0505-44aa-b49c-8066195c2632 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:46.869141 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c2e2db99-7a6b-4e6b-a8b6-5e010512b0fe tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c8b601b-b52b-4a25-8ec2-50d990e0d3c5"}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:46.869378 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-38e3e554-e0ef-4850-848b-e7a9201807ac req-0591d6e6-0505-44aa-b49c-8066195c2632 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:46.876421 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c2e2db99-7a6b-4e6b-a8b6-5e010512b0fe tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:46.893160 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c2e2db99-7a6b-4e6b-a8b6-5e010512b0fe tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:46.895062 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c2e2db99-7a6b-4e6b-a8b6-5e010512b0fe tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:46.896860 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c2e2db99-7a6b-4e6b-a8b6-5e010512b0fe tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:46.898025 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c2e2db99-7a6b-4e6b-a8b6-5e010512b0fe tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:46.898327 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-38e3e554-e0ef-4850-848b-e7a9201807ac req-0591d6e6-0505-44aa-b49c-8066195c2632 service nova] Creating event network-changed:f816b76e-b1f2-4310-aa5d-8e11af558a98 for instance 87114f5c-f2da-4496-9d54-2eb9c3d28916 on hv-cinder-77642 Feb 19 02:28:46.904657 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-38e3e554-e0ef-4850-848b-e7a9201807ac req-0591d6e6-0505-44aa-b49c-8066195c2632 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061045 Feb 19 02:28:46.905474 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 219/424] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:28:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:28:47.029889 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-bce821ae-2e6c-49df-b455-2057da627c41 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:47.030751 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-bce821ae-2e6c-49df-b455-2057da627c41 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] [instance: 87114f5c-f2da-4496-9d54-2eb9c3d28916] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:47.054782 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bce821ae-2e6c-49df-b455-2057da627c41 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:47.055336 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bce821ae-2e6c-49df-b455-2057da627c41 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:47.064826 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bce821ae-2e6c-49df-b455-2057da627c41 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:47.065347 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bce821ae-2e6c-49df-b455-2057da627c41 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:47.463777 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-bce821ae-2e6c-49df-b455-2057da627c41 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593583d805ba40fe83595018ada8b386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43e163eccb44a118e6b89d19bdb5064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:47.478864 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-bce821ae-2e6c-49df-b455-2057da627c41 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] 10.222.0.44 "GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916" status: 200 len: 1314 microversion: 2.1 time: 0.454748 Feb 19 02:28:47.480491 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 220/425] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:47 2021] GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916 => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:47.487154 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-607879e4-c165-4b57-b342-8d7bb59f1222 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:47.488120 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-607879e4-c165-4b57-b342-8d7bb59f1222 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:47.498203 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-607879e4-c165-4b57-b342-8d7bb59f1222 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:47.498989 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-607879e4-c165-4b57-b342-8d7bb59f1222 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:47.500158 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-607879e4-c165-4b57-b342-8d7bb59f1222 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:47.500870 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-607879e4-c165-4b57-b342-8d7bb59f1222 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:47.856688 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-607879e4-c165-4b57-b342-8d7bb59f1222 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:47.868423 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-607879e4-c165-4b57-b342-8d7bb59f1222 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1568 microversion: 2.1 time: 0.385880 Feb 19 02:28:47.879454 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 221/426] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:47 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1568 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:47.887673 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-fcaaa207-e1aa-49ca-82be-8cb8f12f5acd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:47.888294 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-fcaaa207-e1aa-49ca-82be-8cb8f12f5acd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:47.888563 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c2e2db99-7a6b-4e6b-a8b6-5e010512b0fe tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.033362 Feb 19 02:28:47.889538 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 206/427] 10.222.0.44 () {62 vars in 1354 bytes} [Fri Feb 19 02:28:46 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/os-volume_attachments => generated 188 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:28:47.897598 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fcaaa207-e1aa-49ca-82be-8cb8f12f5acd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:47.898091 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fcaaa207-e1aa-49ca-82be-8cb8f12f5acd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:47.899129 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fcaaa207-e1aa-49ca-82be-8cb8f12f5acd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:47.899606 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fcaaa207-e1aa-49ca-82be-8cb8f12f5acd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:48.130739 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c45df69f-393e-40ac-97f8-a21a0dcd6da6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:48.131642 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c45df69f-393e-40ac-97f8-a21a0dcd6da6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:48.161459 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c45df69f-393e-40ac-97f8-a21a0dcd6da6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:48.163823 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c45df69f-393e-40ac-97f8-a21a0dcd6da6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:48.173225 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c45df69f-393e-40ac-97f8-a21a0dcd6da6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:48.174030 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c45df69f-393e-40ac-97f8-a21a0dcd6da6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:48.239096 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-fcaaa207-e1aa-49ca-82be-8cb8f12f5acd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:48.255577 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-fcaaa207-e1aa-49ca-82be-8cb8f12f5acd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1721 microversion: 2.1 time: 0.374604 Feb 19 02:28:48.256235 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 222/428] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:47 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1721 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:48.377540 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-0dc9c608-5643-4299-a498-29bf18c4ea0f req-388f86d5-4d3b-4d47-8f76-3c84fb1b1323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5265f377-f5b9-4f2c-a6e8-3bf64fb08733", "name": "network-vif-unplugged", "status": "completed", "tag": "f7dc3053-2f41-4450-982f-60c5d1f56ee3"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:48.379321 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:28:48.379321 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:28:48.393704 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-0dc9c608-5643-4299-a498-29bf18c4ea0f req-388f86d5-4d3b-4d47-8f76-3c84fb1b1323 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:48.394200 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-0dc9c608-5643-4299-a498-29bf18c4ea0f req-388f86d5-4d3b-4d47-8f76-3c84fb1b1323 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:48.454446 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.compute.server_external_events [req-0dc9c608-5643-4299-a498-29bf18c4ea0f req-388f86d5-4d3b-4d47-8f76-3c84fb1b1323 service nova] Unable to find a host for instance 5265f377-f5b9-4f2c-a6e8-3bf64fb08733. Dropping event network-vif-unplugged {{(pid=98193) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Feb 19 02:28:48.456215 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c45df69f-393e-40ac-97f8-a21a0dcd6da6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action" status: 202 len: 0 microversion: 2.20 time: 0.345975 Feb 19 02:28:48.459178 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 207/429] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:28:48 2021] POST /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 19 02:28:48.471773 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-85417858-dcbf-4a2f-8900-fbaf20b265c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:48.473382 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-0dc9c608-5643-4299-a498-29bf18c4ea0f req-388f86d5-4d3b-4d47-8f76-3c84fb1b1323 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.100147 Feb 19 02:28:48.474021 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 223/430] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:28:48 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 102 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 19 02:28:48.474679 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-85417858-dcbf-4a2f-8900-fbaf20b265c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:48.482868 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-85417858-dcbf-4a2f-8900-fbaf20b265c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:48.483381 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-85417858-dcbf-4a2f-8900-fbaf20b265c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:48.484261 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-85417858-dcbf-4a2f-8900-fbaf20b265c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:48.484703 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-85417858-dcbf-4a2f-8900-fbaf20b265c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:48.501289 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-dcfa3907-14cd-4259-9bcc-9a8f34fa81b7 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:48.501967 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-dcfa3907-14cd-4259-9bcc-9a8f34fa81b7 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] [instance: 87114f5c-f2da-4496-9d54-2eb9c3d28916] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:48.513681 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dcfa3907-14cd-4259-9bcc-9a8f34fa81b7 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:48.514190 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dcfa3907-14cd-4259-9bcc-9a8f34fa81b7 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:48.515083 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dcfa3907-14cd-4259-9bcc-9a8f34fa81b7 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:48.515578 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dcfa3907-14cd-4259-9bcc-9a8f34fa81b7 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:48.826753 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-dcfa3907-14cd-4259-9bcc-9a8f34fa81b7 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593583d805ba40fe83595018ada8b386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43e163eccb44a118e6b89d19bdb5064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:48.839323 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-dcfa3907-14cd-4259-9bcc-9a8f34fa81b7 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] 10.222.0.44 "GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916" status: 200 len: 1314 microversion: 2.1 time: 0.341898 Feb 19 02:28:48.845307 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 224/431] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:48 2021] GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:48.850320 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-660edc8c-8f0e-4691-8806-f48678ebc8a4 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:48.851227 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-660edc8c-8f0e-4691-8806-f48678ebc8a4 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f5b5f904-128e-4b00-b03a-3433a0a0e7fb] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:48.859885 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-660edc8c-8f0e-4691-8806-f48678ebc8a4 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:48.860411 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-660edc8c-8f0e-4691-8806-f48678ebc8a4 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:48.861526 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-660edc8c-8f0e-4691-8806-f48678ebc8a4 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:48.862022 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-660edc8c-8f0e-4691-8806-f48678ebc8a4 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:48.963764 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-660edc8c-8f0e-4691-8806-f48678ebc8a4 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f5b5f904-128e-4b00-b03a-3433a0a0e7fb] Going to try to terminate instance {{(pid=98193) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 02:28:49.071193 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-85417858-dcbf-4a2f-8900-fbaf20b265c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:49.088178 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-85417858-dcbf-4a2f-8900-fbaf20b265c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:49.089757 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-85417858-dcbf-4a2f-8900-fbaf20b265c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:49.091272 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-85417858-dcbf-4a2f-8900-fbaf20b265c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1749 microversion: 2.20 time: 0.623499 Feb 19 02:28:49.092101 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 208/432] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:48 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1749 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:28:49.099707 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b8526f81-3776-401e-a887-572de1d2453b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:49.099707 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b8526f81-3776-401e-a887-572de1d2453b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:49.127496 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b8526f81-3776-401e-a887-572de1d2453b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:49.128000 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b8526f81-3776-401e-a887-572de1d2453b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:49.128941 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b8526f81-3776-401e-a887-572de1d2453b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:49.129455 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b8526f81-3776-401e-a887-572de1d2453b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:49.132755 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-660edc8c-8f0e-4691-8806-f48678ebc8a4 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb" status: 204 len: 0 microversion: 2.1 time: 0.285546 Feb 19 02:28:49.133741 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 225/433] 10.222.0.44 () {58 vars in 1229 bytes} [Fri Feb 19 02:28:48 2021] DELETE /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 02:28:49.148385 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-fbb8e683-efe8-4328-9d2e-e18292c4cedc tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:49.149652 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-fbb8e683-efe8-4328-9d2e-e18292c4cedc tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f5b5f904-128e-4b00-b03a-3433a0a0e7fb] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:49.166944 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fbb8e683-efe8-4328-9d2e-e18292c4cedc tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:49.174786 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fbb8e683-efe8-4328-9d2e-e18292c4cedc tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:49.175956 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fbb8e683-efe8-4328-9d2e-e18292c4cedc tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:49.176612 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fbb8e683-efe8-4328-9d2e-e18292c4cedc tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:49.457240 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-fbb8e683-efe8-4328-9d2e-e18292c4cedc tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:49.472049 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-fbb8e683-efe8-4328-9d2e-e18292c4cedc tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb" status: 200 len: 1512 microversion: 2.1 time: 0.333295 Feb 19 02:28:49.472699 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 226/434] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:49 2021] GET /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb => generated 1512 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:49.480203 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a7b1dcbe-e2c9-47e1-8875-68f52df0c7dd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:49.480880 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a7b1dcbe-e2c9-47e1-8875-68f52df0c7dd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:49.490108 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a7b1dcbe-e2c9-47e1-8875-68f52df0c7dd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:49.490998 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a7b1dcbe-e2c9-47e1-8875-68f52df0c7dd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:49.491482 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a7b1dcbe-e2c9-47e1-8875-68f52df0c7dd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:49.491979 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a7b1dcbe-e2c9-47e1-8875-68f52df0c7dd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:49.754167 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a7b1dcbe-e2c9-47e1-8875-68f52df0c7dd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:49.767437 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a7b1dcbe-e2c9-47e1-8875-68f52df0c7dd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1721 microversion: 2.1 time: 0.293576 Feb 19 02:28:49.768094 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 227/435] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:49 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1721 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:49.812407 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b8526f81-3776-401e-a887-572de1d2453b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:49.841043 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b8526f81-3776-401e-a887-572de1d2453b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1568 microversion: 2.1 time: 0.747745 Feb 19 02:28:49.865119 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 209/436] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:49 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1568 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:49.867225 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-fa4f487c-b628-4fa9-b195-013099c82e5a tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:49.867982 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-fa4f487c-b628-4fa9-b195-013099c82e5a tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] [instance: 87114f5c-f2da-4496-9d54-2eb9c3d28916] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:49.878678 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fa4f487c-b628-4fa9-b195-013099c82e5a tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:49.879196 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fa4f487c-b628-4fa9-b195-013099c82e5a tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:49.880078 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fa4f487c-b628-4fa9-b195-013099c82e5a tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:49.880908 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fa4f487c-b628-4fa9-b195-013099c82e5a tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:50.116071 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a8c3e744-dd73-4c51-8017-7aee4179c7cb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:50.117236 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a8c3e744-dd73-4c51-8017-7aee4179c7cb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:50.131001 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a8c3e744-dd73-4c51-8017-7aee4179c7cb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:50.131682 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a8c3e744-dd73-4c51-8017-7aee4179c7cb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:50.140034 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a8c3e744-dd73-4c51-8017-7aee4179c7cb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:50.140803 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a8c3e744-dd73-4c51-8017-7aee4179c7cb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:50.224434 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-fa4f487c-b628-4fa9-b195-013099c82e5a tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593583d805ba40fe83595018ada8b386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43e163eccb44a118e6b89d19bdb5064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:50.240933 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-fa4f487c-b628-4fa9-b195-013099c82e5a tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] 10.222.0.44 "GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916" status: 200 len: 1314 microversion: 2.1 time: 0.380277 Feb 19 02:28:50.252217 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 228/437] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:49 2021] GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916 => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:50.420663 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a8c3e744-dd73-4c51-8017-7aee4179c7cb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:50.435959 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a8c3e744-dd73-4c51-8017-7aee4179c7cb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:50.437792 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a8c3e744-dd73-4c51-8017-7aee4179c7cb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:50.439315 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a8c3e744-dd73-4c51-8017-7aee4179c7cb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1751 microversion: 2.20 time: 0.329216 Feb 19 02:28:50.440303 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 210/438] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:50 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1751 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:28:50.490711 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8aa00300-ca8d-4fee-8956-8e0fc6f97303 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:50.491738 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8aa00300-ca8d-4fee-8956-8e0fc6f97303 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f5b5f904-128e-4b00-b03a-3433a0a0e7fb] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:50.501124 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8aa00300-ca8d-4fee-8956-8e0fc6f97303 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:50.501788 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8aa00300-ca8d-4fee-8956-8e0fc6f97303 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:50.502871 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8aa00300-ca8d-4fee-8956-8e0fc6f97303 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:50.503411 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8aa00300-ca8d-4fee-8956-8e0fc6f97303 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:50.765655 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8aa00300-ca8d-4fee-8956-8e0fc6f97303 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:50.776976 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8aa00300-ca8d-4fee-8956-8e0fc6f97303 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb" status: 200 len: 1512 microversion: 2.1 time: 0.290358 Feb 19 02:28:50.778414 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 229/439] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:50 2021] GET /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb => generated 1512 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:28:50.786050 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a0624f03-c464-4b94-b5d8-05bdd8e0b1d2 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:50.787349 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a0624f03-c464-4b94-b5d8-05bdd8e0b1d2 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:50.797378 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a0624f03-c464-4b94-b5d8-05bdd8e0b1d2 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:50.797900 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a0624f03-c464-4b94-b5d8-05bdd8e0b1d2 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:50.798927 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a0624f03-c464-4b94-b5d8-05bdd8e0b1d2 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:50.799609 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a0624f03-c464-4b94-b5d8-05bdd8e0b1d2 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:50.870675 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b1d95b6d-c835-447a-a6ed-d2ffbf5dc5d6 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:50.872636 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b1d95b6d-c835-447a-a6ed-d2ffbf5dc5d6 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:50.883952 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b1d95b6d-c835-447a-a6ed-d2ffbf5dc5d6 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:50.885338 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b1d95b6d-c835-447a-a6ed-d2ffbf5dc5d6 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:50.887041 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b1d95b6d-c835-447a-a6ed-d2ffbf5dc5d6 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:50.887913 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b1d95b6d-c835-447a-a6ed-d2ffbf5dc5d6 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:51.149803 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b1d95b6d-c835-447a-a6ed-d2ffbf5dc5d6 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:51.162329 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b1d95b6d-c835-447a-a6ed-d2ffbf5dc5d6 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1568 microversion: 2.1 time: 0.296585 Feb 19 02:28:51.166880 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 230/440] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:50 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1568 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:51.260585 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1c86c0f1-e7f3-4744-b2c0-4b2c8c00e92e tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:51.261812 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1c86c0f1-e7f3-4744-b2c0-4b2c8c00e92e tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] [instance: 87114f5c-f2da-4496-9d54-2eb9c3d28916] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:51.277407 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1c86c0f1-e7f3-4744-b2c0-4b2c8c00e92e tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:51.280414 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1c86c0f1-e7f3-4744-b2c0-4b2c8c00e92e tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:51.281453 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1c86c0f1-e7f3-4744-b2c0-4b2c8c00e92e tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:51.281966 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1c86c0f1-e7f3-4744-b2c0-4b2c8c00e92e tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:51.354046 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a0624f03-c464-4b94-b5d8-05bdd8e0b1d2 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:51.367350 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a0624f03-c464-4b94-b5d8-05bdd8e0b1d2 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1721 microversion: 2.1 time: 0.585210 Feb 19 02:28:51.372067 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 211/441] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:50 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1721 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:51.463692 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-679db9bc-5ac9-4c7d-9b13-e9e7ca8bd6d1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:51.464491 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-679db9bc-5ac9-4c7d-9b13-e9e7ca8bd6d1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:51.473639 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-679db9bc-5ac9-4c7d-9b13-e9e7ca8bd6d1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:51.474471 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-679db9bc-5ac9-4c7d-9b13-e9e7ca8bd6d1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:51.475459 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-679db9bc-5ac9-4c7d-9b13-e9e7ca8bd6d1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:51.476038 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-679db9bc-5ac9-4c7d-9b13-e9e7ca8bd6d1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:52.080642 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-679db9bc-5ac9-4c7d-9b13-e9e7ca8bd6d1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:52.090789 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-679db9bc-5ac9-4c7d-9b13-e9e7ca8bd6d1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:52.092446 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-679db9bc-5ac9-4c7d-9b13-e9e7ca8bd6d1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:52.093788 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-679db9bc-5ac9-4c7d-9b13-e9e7ca8bd6d1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1751 microversion: 2.20 time: 0.635602 Feb 19 02:28:52.107092 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 212/442] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:51 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1751 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:28:52.112303 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8986bbe0-2536-4fd9-8c99-271f10123c51 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:52.112971 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8986bbe0-2536-4fd9-8c99-271f10123c51 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f5b5f904-128e-4b00-b03a-3433a0a0e7fb] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:52.121581 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8986bbe0-2536-4fd9-8c99-271f10123c51 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:52.121858 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8986bbe0-2536-4fd9-8c99-271f10123c51 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:52.122650 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8986bbe0-2536-4fd9-8c99-271f10123c51 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:52.123146 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8986bbe0-2536-4fd9-8c99-271f10123c51 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:52.199900 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-1c86c0f1-e7f3-4744-b2c0-4b2c8c00e92e tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593583d805ba40fe83595018ada8b386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43e163eccb44a118e6b89d19bdb5064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:52.213541 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1c86c0f1-e7f3-4744-b2c0-4b2c8c00e92e tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] 10.222.0.44 "GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916" status: 200 len: 1314 microversion: 2.1 time: 0.956979 Feb 19 02:28:52.222507 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 231/443] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:51 2021] GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916 => generated 1314 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:52.228334 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-521e15bd-da04-4433-adc5-63e95eaa8c3e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:52.229021 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-521e15bd-da04-4433-adc5-63e95eaa8c3e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:52.243891 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-521e15bd-da04-4433-adc5-63e95eaa8c3e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:52.244413 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-521e15bd-da04-4433-adc5-63e95eaa8c3e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:52.245366 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-521e15bd-da04-4433-adc5-63e95eaa8c3e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:52.245909 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-521e15bd-da04-4433-adc5-63e95eaa8c3e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:52.563046 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8986bbe0-2536-4fd9-8c99-271f10123c51 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:52.582485 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8986bbe0-2536-4fd9-8c99-271f10123c51 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb" status: 200 len: 1512 microversion: 2.1 time: 0.471011 Feb 19 02:28:52.583577 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 213/444] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:52 2021] GET /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb => generated 1512 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:52.608797 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-79c2a7ee-3216-45d6-a86a-544ca91179f3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:52.613569 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-79c2a7ee-3216-45d6-a86a-544ca91179f3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:52.629555 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-79c2a7ee-3216-45d6-a86a-544ca91179f3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:52.630320 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-79c2a7ee-3216-45d6-a86a-544ca91179f3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:52.631423 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-79c2a7ee-3216-45d6-a86a-544ca91179f3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:52.632096 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-79c2a7ee-3216-45d6-a86a-544ca91179f3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:53.123381 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-521e15bd-da04-4433-adc5-63e95eaa8c3e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:53.135071 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-521e15bd-da04-4433-adc5-63e95eaa8c3e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1568 microversion: 2.1 time: 0.910711 Feb 19 02:28:53.135296 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 232/445] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:52 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1568 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:53.165325 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7c990fc2-5ff5-44fa-9d26-23568c11503c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:53.165990 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7c990fc2-5ff5-44fa-9d26-23568c11503c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:53.197772 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7c990fc2-5ff5-44fa-9d26-23568c11503c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:53.198279 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7c990fc2-5ff5-44fa-9d26-23568c11503c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:53.199164 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7c990fc2-5ff5-44fa-9d26-23568c11503c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:53.199852 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7c990fc2-5ff5-44fa-9d26-23568c11503c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:53.249836 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-79c2a7ee-3216-45d6-a86a-544ca91179f3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:53.263606 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-79c2a7ee-3216-45d6-a86a-544ca91179f3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1698 microversion: 2.1 time: 0.666628 Feb 19 02:28:53.268617 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 214/446] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:52 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1698 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:53.275609 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-8847846d-c351-419f-bf53-73e2f7355f95 req-21d35417-2f2b-442a-8156-a1a7db3261bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5b5f904-128e-4b00-b03a-3433a0a0e7fb", "name": "network-vif-deleted", "tag": "1fd8fd6a-2729-467c-9613-3df4488a3a59"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:53.277575 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:28:53.277575 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:28:53.303512 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-8847846d-c351-419f-bf53-73e2f7355f95 req-21d35417-2f2b-442a-8156-a1a7db3261bc service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:53.304462 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-8847846d-c351-419f-bf53-73e2f7355f95 req-21d35417-2f2b-442a-8156-a1a7db3261bc service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:53.328429 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-8847846d-c351-419f-bf53-73e2f7355f95 req-21d35417-2f2b-442a-8156-a1a7db3261bc service nova] Creating event network-vif-deleted:1fd8fd6a-2729-467c-9613-3df4488a3a59 for instance f5b5f904-128e-4b00-b03a-3433a0a0e7fb on hv-cinder-77642 Feb 19 02:28:53.336088 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-8847846d-c351-419f-bf53-73e2f7355f95 req-21d35417-2f2b-442a-8156-a1a7db3261bc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065340 Feb 19 02:28:53.337617 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 215/447] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:28:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:28:53.344899 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-40650e65-565e-4a68-b22b-65616286e436 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:53.346381 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-40650e65-565e-4a68-b22b-65616286e436 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] [instance: 87114f5c-f2da-4496-9d54-2eb9c3d28916] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:53.372451 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-40650e65-565e-4a68-b22b-65616286e436 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:53.373467 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-40650e65-565e-4a68-b22b-65616286e436 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:53.377639 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-40650e65-565e-4a68-b22b-65616286e436 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:53.378652 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-40650e65-565e-4a68-b22b-65616286e436 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:53.600658 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7c990fc2-5ff5-44fa-9d26-23568c11503c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:53.616847 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7c990fc2-5ff5-44fa-9d26-23568c11503c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:53.619061 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7c990fc2-5ff5-44fa-9d26-23568c11503c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:53.620321 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7c990fc2-5ff5-44fa-9d26-23568c11503c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1751 microversion: 2.20 time: 0.459264 Feb 19 02:28:53.620939 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 233/448] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:53 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1751 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:28:53.644666 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f06ec510-c7ab-4e7e-a66a-e887eb6f7bb7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:53.670705 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f06ec510-c7ab-4e7e-a66a-e887eb6f7bb7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:53.671216 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f06ec510-c7ab-4e7e-a66a-e887eb6f7bb7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:53.698740 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-40650e65-565e-4a68-b22b-65616286e436 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593583d805ba40fe83595018ada8b386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43e163eccb44a118e6b89d19bdb5064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:53.712558 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-40650e65-565e-4a68-b22b-65616286e436 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] 10.222.0.44 "GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916" status: 200 len: 1314 microversion: 2.1 time: 0.373010 Feb 19 02:28:53.713405 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 216/449] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:53 2021] GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916 => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:53.719263 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-cc5fdf65-4191-4b65-a991-485a96d9a98d req-caf43d98-956d-4027-a460-5e109d20c086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87114f5c-f2da-4496-9d54-2eb9c3d28916", "name": "network-vif-plugged", "status": "completed", "tag": "f816b76e-b1f2-4310-aa5d-8e11af558a98"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:28:53.721016 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:28:53.721016 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:28:53.730958 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-cc5fdf65-4191-4b65-a991-485a96d9a98d req-caf43d98-956d-4027-a460-5e109d20c086 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:53.731618 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-cc5fdf65-4191-4b65-a991-485a96d9a98d req-caf43d98-956d-4027-a460-5e109d20c086 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:53.750155 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f06ec510-c7ab-4e7e-a66a-e887eb6f7bb7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Going to try to start instance {{(pid=98193) start /opt/stack/nova/nova/compute/api.py:2603}} Feb 19 02:28:53.752751 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-cc5fdf65-4191-4b65-a991-485a96d9a98d req-caf43d98-956d-4027-a460-5e109d20c086 service nova] Creating event network-vif-plugged:f816b76e-b1f2-4310-aa5d-8e11af558a98 for instance 87114f5c-f2da-4496-9d54-2eb9c3d28916 on hv-cinder-77642 Feb 19 02:28:53.757915 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-cc5fdf65-4191-4b65-a991-485a96d9a98d req-caf43d98-956d-4027-a460-5e109d20c086 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042658 Feb 19 02:28:53.758906 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 217/450] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:28:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:28:53.764471 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ab48aaae-d5ec-4ec3-a77e-dff51fdff193 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:53.765218 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ab48aaae-d5ec-4ec3-a77e-dff51fdff193 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f5b5f904-128e-4b00-b03a-3433a0a0e7fb] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:53.785610 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ab48aaae-d5ec-4ec3-a77e-dff51fdff193 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:53.785610 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ab48aaae-d5ec-4ec3-a77e-dff51fdff193 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:53.786013 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ab48aaae-d5ec-4ec3-a77e-dff51fdff193 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:53.786366 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ab48aaae-d5ec-4ec3-a77e-dff51fdff193 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:53.848884 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f06ec510-c7ab-4e7e-a66a-e887eb6f7bb7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 202 len: 0 microversion: 2.1 time: 0.226384 Feb 19 02:28:53.849896 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 234/451] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:28:53 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:28:53.860696 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-3290726c-8c33-43ed-b209-110a6478a873 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:53.861471 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-3290726c-8c33-43ed-b209-110a6478a873 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:53.876749 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3290726c-8c33-43ed-b209-110a6478a873 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:53.886620 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3290726c-8c33-43ed-b209-110a6478a873 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:53.890033 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3290726c-8c33-43ed-b209-110a6478a873 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:53.890033 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3290726c-8c33-43ed-b209-110a6478a873 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:53.908885 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ab48aaae-d5ec-4ec3-a77e-dff51fdff193 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:53.909402 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ab48aaae-d5ec-4ec3-a77e-dff51fdff193 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:53.910003 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.objects.instance [None req-ab48aaae-d5ec-4ec3-a77e-dff51fdff193 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lazy-loading 'fault' on Instance uuid f5b5f904-128e-4b00-b03a-3433a0a0e7fb {{(pid=98194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 02:28:54.038103 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ab48aaae-d5ec-4ec3-a77e-dff51fdff193 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:54.048414 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ab48aaae-d5ec-4ec3-a77e-dff51fdff193 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb" status: 200 len: 1308 microversion: 2.1 time: 0.288244 Feb 19 02:28:54.049062 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 218/452] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:53 2021] GET /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb => generated 1308 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:54.153520 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-0ac32e21-f57a-409a-8f95-3651f88ec5bb tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:54.154199 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-0ac32e21-f57a-409a-8f95-3651f88ec5bb tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:54.172233 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0ac32e21-f57a-409a-8f95-3651f88ec5bb tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:54.172749 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0ac32e21-f57a-409a-8f95-3651f88ec5bb tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:54.173667 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0ac32e21-f57a-409a-8f95-3651f88ec5bb tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:54.174172 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0ac32e21-f57a-409a-8f95-3651f88ec5bb tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:54.285901 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-3290726c-8c33-43ed-b209-110a6478a873 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:54.298637 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-3290726c-8c33-43ed-b209-110a6478a873 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1707 microversion: 2.1 time: 0.443647 Feb 19 02:28:54.302554 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 235/453] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:53 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1707 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:54.595161 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-0ac32e21-f57a-409a-8f95-3651f88ec5bb tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:54.626886 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-0ac32e21-f57a-409a-8f95-3651f88ec5bb tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1568 microversion: 2.1 time: 0.477811 Feb 19 02:28:54.627524 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 219/454] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:54 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1568 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:54.641222 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-489e4f60-94a7-4d2f-8f34-0bd72e70ec6e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:54.642487 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-489e4f60-94a7-4d2f-8f34-0bd72e70ec6e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:54.651252 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-489e4f60-94a7-4d2f-8f34-0bd72e70ec6e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:54.651769 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-489e4f60-94a7-4d2f-8f34-0bd72e70ec6e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:54.652633 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-489e4f60-94a7-4d2f-8f34-0bd72e70ec6e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:54.653137 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-489e4f60-94a7-4d2f-8f34-0bd72e70ec6e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:54.733056 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-966cdb34-3632-4230-a6fe-1fdaa59dc611 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:54.733728 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-966cdb34-3632-4230-a6fe-1fdaa59dc611 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] [instance: 87114f5c-f2da-4496-9d54-2eb9c3d28916] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:54.746493 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-966cdb34-3632-4230-a6fe-1fdaa59dc611 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:54.746910 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-966cdb34-3632-4230-a6fe-1fdaa59dc611 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:54.747802 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-966cdb34-3632-4230-a6fe-1fdaa59dc611 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:54.748273 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-966cdb34-3632-4230-a6fe-1fdaa59dc611 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:55.122296 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-489e4f60-94a7-4d2f-8f34-0bd72e70ec6e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:55.133925 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-489e4f60-94a7-4d2f-8f34-0bd72e70ec6e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:55.136141 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-489e4f60-94a7-4d2f-8f34-0bd72e70ec6e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:55.137600 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-489e4f60-94a7-4d2f-8f34-0bd72e70ec6e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1807 microversion: 2.20 time: 0.500858 Feb 19 02:28:55.138403 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 236/455] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:54 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1807 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:28:55.155813 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a03051d6-e0fe-4d5e-8405-bca8c11eaae5 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:55.157057 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a03051d6-e0fe-4d5e-8405-bca8c11eaae5 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f5b5f904-128e-4b00-b03a-3433a0a0e7fb] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:55.176546 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a03051d6-e0fe-4d5e-8405-bca8c11eaae5 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:55.177347 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a03051d6-e0fe-4d5e-8405-bca8c11eaae5 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:55.178411 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a03051d6-e0fe-4d5e-8405-bca8c11eaae5 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:55.179070 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a03051d6-e0fe-4d5e-8405-bca8c11eaae5 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:55.231784 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-966cdb34-3632-4230-a6fe-1fdaa59dc611 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593583d805ba40fe83595018ada8b386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43e163eccb44a118e6b89d19bdb5064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:55.241811 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-966cdb34-3632-4230-a6fe-1fdaa59dc611 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] 10.222.0.44 "GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916" status: 200 len: 1314 microversion: 2.1 time: 0.512733 Feb 19 02:28:55.258554 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 220/456] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:54 2021] GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916 => generated 1314 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:55.318586 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-96593fa1-8f52-4e37-b400-91ebc3d30940 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:55.319286 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-96593fa1-8f52-4e37-b400-91ebc3d30940 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:55.333428 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a03051d6-e0fe-4d5e-8405-bca8c11eaae5 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:55.337252 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a03051d6-e0fe-4d5e-8405-bca8c11eaae5 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:55.338904 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.objects.instance [None req-a03051d6-e0fe-4d5e-8405-bca8c11eaae5 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lazy-loading 'fault' on Instance uuid f5b5f904-128e-4b00-b03a-3433a0a0e7fb {{(pid=98193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 02:28:55.343185 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-96593fa1-8f52-4e37-b400-91ebc3d30940 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:55.343757 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-96593fa1-8f52-4e37-b400-91ebc3d30940 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:55.349949 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-96593fa1-8f52-4e37-b400-91ebc3d30940 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:55.350666 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-96593fa1-8f52-4e37-b400-91ebc3d30940 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:55.552069 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a03051d6-e0fe-4d5e-8405-bca8c11eaae5 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:55.566830 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a03051d6-e0fe-4d5e-8405-bca8c11eaae5 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb" status: 200 len: 1308 microversion: 2.1 time: 0.414823 Feb 19 02:28:55.579225 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 237/457] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:55 2021] GET /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb => generated 1308 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:55.647834 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-656ba061-8416-4a7e-a41b-480837e6cad0 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:55.649424 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-656ba061-8416-4a7e-a41b-480837e6cad0 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:55.665684 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-656ba061-8416-4a7e-a41b-480837e6cad0 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:55.667565 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-656ba061-8416-4a7e-a41b-480837e6cad0 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:55.673432 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-656ba061-8416-4a7e-a41b-480837e6cad0 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:55.674329 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-656ba061-8416-4a7e-a41b-480837e6cad0 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:55.834315 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-96593fa1-8f52-4e37-b400-91ebc3d30940 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:55.848726 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-96593fa1-8f52-4e37-b400-91ebc3d30940 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1707 microversion: 2.1 time: 0.535161 Feb 19 02:28:55.859817 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 221/458] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:55 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1707 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:56.071179 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-656ba061-8416-4a7e-a41b-480837e6cad0 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:56.084914 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-656ba061-8416-4a7e-a41b-480837e6cad0 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1568 microversion: 2.1 time: 0.441129 Feb 19 02:28:56.085507 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 238/459] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:55 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1568 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:28:56.158911 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-6cb0c164-a957-4fc5-b5d2-b0cbaf683cea tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:56.159724 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-6cb0c164-a957-4fc5-b5d2-b0cbaf683cea tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:56.185117 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6cb0c164-a957-4fc5-b5d2-b0cbaf683cea tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:56.185635 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6cb0c164-a957-4fc5-b5d2-b0cbaf683cea tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:56.186884 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6cb0c164-a957-4fc5-b5d2-b0cbaf683cea tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:56.188677 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6cb0c164-a957-4fc5-b5d2-b0cbaf683cea tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:56.261160 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-32587ef7-4843-41cb-b41e-0efe099d7275 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:56.262984 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-32587ef7-4843-41cb-b41e-0efe099d7275 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] [instance: 87114f5c-f2da-4496-9d54-2eb9c3d28916] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:56.280764 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-32587ef7-4843-41cb-b41e-0efe099d7275 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:56.283558 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-32587ef7-4843-41cb-b41e-0efe099d7275 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:56.284511 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-32587ef7-4843-41cb-b41e-0efe099d7275 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:56.290535 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-32587ef7-4843-41cb-b41e-0efe099d7275 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:56.678575 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-6cb0c164-a957-4fc5-b5d2-b0cbaf683cea tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:56.708479 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-6cb0c164-a957-4fc5-b5d2-b0cbaf683cea tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:56.712513 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-6cb0c164-a957-4fc5-b5d2-b0cbaf683cea tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:56.714266 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-6cb0c164-a957-4fc5-b5d2-b0cbaf683cea tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1807 microversion: 2.20 time: 0.560560 Feb 19 02:28:56.731046 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 222/460] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:56 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1807 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:28:56.737964 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b12b3e7a-8527-43b8-8221-7c39ac64a299 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:56.739018 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b12b3e7a-8527-43b8-8221-7c39ac64a299 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f5b5f904-128e-4b00-b03a-3433a0a0e7fb] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:56.748498 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b12b3e7a-8527-43b8-8221-7c39ac64a299 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:56.749505 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b12b3e7a-8527-43b8-8221-7c39ac64a299 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:56.750625 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b12b3e7a-8527-43b8-8221-7c39ac64a299 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:56.752006 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b12b3e7a-8527-43b8-8221-7c39ac64a299 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:56.830999 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-b12b3e7a-8527-43b8-8221-7c39ac64a299 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] HTTP exception thrown: Instance f5b5f904-128e-4b00-b03a-3433a0a0e7fb could not be found. Feb 19 02:28:56.832259 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b12b3e7a-8527-43b8-8221-7c39ac64a299 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Returning 404 to user: Instance f5b5f904-128e-4b00-b03a-3433a0a0e7fb could not be found. {{(pid=98194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:28:56.833604 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b12b3e7a-8527-43b8-8221-7c39ac64a299 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb" status: 404 len: 111 microversion: 2.1 time: 0.100419 Feb 19 02:28:56.834924 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 223/461] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:56 2021] GET /compute/v2.1/servers/f5b5f904-128e-4b00-b03a-3433a0a0e7fb => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 02:28:56.993464 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-cf756173-e787-4f61-96a6-9f639f2e6cce tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:56.993464 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-cf756173-e787-4f61-96a6-9f639f2e6cce tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:56.993464 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cf756173-e787-4f61-96a6-9f639f2e6cce tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:56.993464 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cf756173-e787-4f61-96a6-9f639f2e6cce tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:56.995107 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cf756173-e787-4f61-96a6-9f639f2e6cce tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:56.995107 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cf756173-e787-4f61-96a6-9f639f2e6cce tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:57.065710 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-32587ef7-4843-41cb-b41e-0efe099d7275 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593583d805ba40fe83595018ada8b386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43e163eccb44a118e6b89d19bdb5064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:57.089537 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-32587ef7-4843-41cb-b41e-0efe099d7275 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] 10.222.0.44 "GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916" status: 200 len: 1314 microversion: 2.1 time: 0.827827 Feb 19 02:28:57.090401 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 239/462] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:56 2021] GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916 => generated 1314 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:57.136951 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-19ec079e-bd7b-4bf6-872f-53bb2bc3caf8 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:57.147402 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-19ec079e-bd7b-4bf6-872f-53bb2bc3caf8 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:57.170629 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-19ec079e-bd7b-4bf6-872f-53bb2bc3caf8 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:57.173280 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-19ec079e-bd7b-4bf6-872f-53bb2bc3caf8 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:57.174325 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-19ec079e-bd7b-4bf6-872f-53bb2bc3caf8 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:57.174941 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-19ec079e-bd7b-4bf6-872f-53bb2bc3caf8 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:57.418249 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-cf756173-e787-4f61-96a6-9f639f2e6cce tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:57.429093 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-cf756173-e787-4f61-96a6-9f639f2e6cce tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1707 microversion: 2.1 time: 0.536775 Feb 19 02:28:57.429739 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 224/463] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:56 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1707 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:57.482003 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-19ec079e-bd7b-4bf6-872f-53bb2bc3caf8 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:57.496169 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-19ec079e-bd7b-4bf6-872f-53bb2bc3caf8 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1568 microversion: 2.1 time: 0.389622 Feb 19 02:28:57.496829 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 240/464] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:57 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1568 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:57.737420 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-898053f3-d45b-4549-82ac-2e6e797c51e2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:57.738012 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-898053f3-d45b-4549-82ac-2e6e797c51e2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:57.749995 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-898053f3-d45b-4549-82ac-2e6e797c51e2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:57.750473 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-898053f3-d45b-4549-82ac-2e6e797c51e2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:57.751308 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-898053f3-d45b-4549-82ac-2e6e797c51e2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:57.751989 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-898053f3-d45b-4549-82ac-2e6e797c51e2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:58.067361 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-898053f3-d45b-4549-82ac-2e6e797c51e2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:58.078919 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-898053f3-d45b-4549-82ac-2e6e797c51e2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:58.080885 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-898053f3-d45b-4549-82ac-2e6e797c51e2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:58.082422 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-898053f3-d45b-4549-82ac-2e6e797c51e2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1807 microversion: 2.20 time: 0.349067 Feb 19 02:28:58.095607 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 225/465] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:57 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1807 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:28:58.128154 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8baaec0f-5d01-4d4c-bac7-d381ece1a961 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:58.129155 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8baaec0f-5d01-4d4c-bac7-d381ece1a961 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] [instance: 87114f5c-f2da-4496-9d54-2eb9c3d28916] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:58.140771 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8baaec0f-5d01-4d4c-bac7-d381ece1a961 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:58.141297 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8baaec0f-5d01-4d4c-bac7-d381ece1a961 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:58.142500 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8baaec0f-5d01-4d4c-bac7-d381ece1a961 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:58.142874 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8baaec0f-5d01-4d4c-bac7-d381ece1a961 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:58.436095 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-2b80b683-1463-4aa5-b944-447c67e7404b tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:58.437395 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-2b80b683-1463-4aa5-b944-447c67e7404b tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: 87ce73f0-276b-4a23-9a93-51e8297cab10] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:58.479383 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2b80b683-1463-4aa5-b944-447c67e7404b tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:58.482977 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2b80b683-1463-4aa5-b944-447c67e7404b tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:58.487587 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2b80b683-1463-4aa5-b944-447c67e7404b tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:58.488759 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2b80b683-1463-4aa5-b944-447c67e7404b tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:58.505449 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8baaec0f-5d01-4d4c-bac7-d381ece1a961 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593583d805ba40fe83595018ada8b386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43e163eccb44a118e6b89d19bdb5064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:58.521759 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8baaec0f-5d01-4d4c-bac7-d381ece1a961 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] 10.222.0.44 "GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916" status: 200 len: 1463 microversion: 2.1 time: 0.398562 Feb 19 02:28:58.522522 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 241/466] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:58 2021] GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916 => generated 1463 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:58.566125 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-0bbfdd7c-a0b8-4875-bf49-337b2921f8cb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:58.566866 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-0bbfdd7c-a0b8-4875-bf49-337b2921f8cb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:58.590238 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0bbfdd7c-a0b8-4875-bf49-337b2921f8cb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:58.593525 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0bbfdd7c-a0b8-4875-bf49-337b2921f8cb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:58.594438 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0bbfdd7c-a0b8-4875-bf49-337b2921f8cb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:58.594954 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0bbfdd7c-a0b8-4875-bf49-337b2921f8cb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:58.692794 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-2b80b683-1463-4aa5-b944-447c67e7404b tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: 87ce73f0-276b-4a23-9a93-51e8297cab10] Going to try to terminate instance {{(pid=98194) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 02:28:58.895825 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-2b80b683-1463-4aa5-b944-447c67e7404b tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "DELETE /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10" status: 204 len: 0 microversion: 2.1 time: 0.470283 Feb 19 02:28:58.900437 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 226/467] 10.222.0.44 () {58 vars in 1229 bytes} [Fri Feb 19 02:28:58 2021] DELETE /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 02:28:58.936377 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-3b62ec75-23c5-4f4c-8604-76e3ab6df535 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:58.938652 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-3b62ec75-23c5-4f4c-8604-76e3ab6df535 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:58.967084 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3b62ec75-23c5-4f4c-8604-76e3ab6df535 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:58.967985 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3b62ec75-23c5-4f4c-8604-76e3ab6df535 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:58.974125 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3b62ec75-23c5-4f4c-8604-76e3ab6df535 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:58.974933 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3b62ec75-23c5-4f4c-8604-76e3ab6df535 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:59.041692 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-0bbfdd7c-a0b8-4875-bf49-337b2921f8cb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:59.054208 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-0bbfdd7c-a0b8-4875-bf49-337b2921f8cb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1707 microversion: 2.1 time: 0.499281 Feb 19 02:28:59.065711 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 242/468] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:58 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1707 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:59.065711 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-6a8e5048-cdee-4e51-b672-d9248cf998c7 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:59.065711 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-6a8e5048-cdee-4e51-b672-d9248cf998c7 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] [instance: 87114f5c-f2da-4496-9d54-2eb9c3d28916] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:59.070412 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6a8e5048-cdee-4e51-b672-d9248cf998c7 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:59.071034 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6a8e5048-cdee-4e51-b672-d9248cf998c7 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:59.071947 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6a8e5048-cdee-4e51-b672-d9248cf998c7 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:59.072487 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6a8e5048-cdee-4e51-b672-d9248cf998c7 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:59.147430 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-6a8e5048-cdee-4e51-b672-d9248cf998c7 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] [instance: 87114f5c-f2da-4496-9d54-2eb9c3d28916] Going to try to terminate instance {{(pid=98193) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 02:28:59.335023 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-3b62ec75-23c5-4f4c-8604-76e3ab6df535 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:59.351154 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-3b62ec75-23c5-4f4c-8604-76e3ab6df535 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1568 microversion: 2.1 time: 0.445128 Feb 19 02:28:59.352543 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 227/469] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:58 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1568 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:59.358253 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-413d93a0-d1ce-4c05-9219-aca176ed31b9 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:59.359225 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-413d93a0-d1ce-4c05-9219-aca176ed31b9 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: 87ce73f0-276b-4a23-9a93-51e8297cab10] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:59.380103 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-413d93a0-d1ce-4c05-9219-aca176ed31b9 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:59.380610 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-413d93a0-d1ce-4c05-9219-aca176ed31b9 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:59.381470 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-413d93a0-d1ce-4c05-9219-aca176ed31b9 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:59.381967 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-413d93a0-d1ce-4c05-9219-aca176ed31b9 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:59.558930 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-6a8e5048-cdee-4e51-b672-d9248cf998c7 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] 10.222.0.44 "DELETE /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916" status: 204 len: 0 microversion: 2.1 time: 0.501699 Feb 19 02:28:59.559568 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 243/470] 10.222.0.44 () {58 vars in 1229 bytes} [Fri Feb 19 02:28:59 2021] DELETE /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 02:28:59.565677 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-53abe2fe-6ad4-4889-b09d-d92c5610ba9a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:59.568669 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-53abe2fe-6ad4-4889-b09d-d92c5610ba9a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:59.604268 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-53abe2fe-6ad4-4889-b09d-d92c5610ba9a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:59.610887 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-53abe2fe-6ad4-4889-b09d-d92c5610ba9a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:59.612166 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-53abe2fe-6ad4-4889-b09d-d92c5610ba9a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:59.614828 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-53abe2fe-6ad4-4889-b09d-d92c5610ba9a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:59.787566 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-413d93a0-d1ce-4c05-9219-aca176ed31b9 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:28:59.807919 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-413d93a0-d1ce-4c05-9219-aca176ed31b9 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10" status: 200 len: 1511 microversion: 2.1 time: 0.454304 Feb 19 02:28:59.808569 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 228/471] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:59 2021] GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10 => generated 1511 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:28:59.813483 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d1b24ecf-97ff-4e17-af99-ccbeabea3aa9 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:28:59.814080 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d1b24ecf-97ff-4e17-af99-ccbeabea3aa9 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] [instance: 87114f5c-f2da-4496-9d54-2eb9c3d28916] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:28:59.834180 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d1b24ecf-97ff-4e17-af99-ccbeabea3aa9 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:59.834718 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d1b24ecf-97ff-4e17-af99-ccbeabea3aa9 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:28:59.835575 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d1b24ecf-97ff-4e17-af99-ccbeabea3aa9 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:28:59.836160 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d1b24ecf-97ff-4e17-af99-ccbeabea3aa9 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:00.160645 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-53abe2fe-6ad4-4889-b09d-d92c5610ba9a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:00.178875 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-53abe2fe-6ad4-4889-b09d-d92c5610ba9a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:00.183384 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-53abe2fe-6ad4-4889-b09d-d92c5610ba9a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:00.193102 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-53abe2fe-6ad4-4889-b09d-d92c5610ba9a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1807 microversion: 2.20 time: 0.632265 Feb 19 02:29:00.207574 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 244/472] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:28:59 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1807 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:29:00.214402 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b2eaff43-42ee-4e89-ad51-081573fe5a0a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:00.215444 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b2eaff43-42ee-4e89-ad51-081573fe5a0a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:00.224647 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b2eaff43-42ee-4e89-ad51-081573fe5a0a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:00.225563 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b2eaff43-42ee-4e89-ad51-081573fe5a0a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:00.227229 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b2eaff43-42ee-4e89-ad51-081573fe5a0a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:00.228269 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b2eaff43-42ee-4e89-ad51-081573fe5a0a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:00.294863 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-d1b24ecf-97ff-4e17-af99-ccbeabea3aa9 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593583d805ba40fe83595018ada8b386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43e163eccb44a118e6b89d19bdb5064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:00.315375 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d1b24ecf-97ff-4e17-af99-ccbeabea3aa9 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] 10.222.0.44 "GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916" status: 200 len: 1469 microversion: 2.1 time: 0.504394 Feb 19 02:29:00.318788 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 229/473] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:28:59 2021] GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916 => generated 1469 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:00.384917 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-9ea2a07b-89e3-4b87-b93d-554748516b64 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:00.385634 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-9ea2a07b-89e3-4b87-b93d-554748516b64 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:00.462943 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9ea2a07b-89e3-4b87-b93d-554748516b64 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:00.495897 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9ea2a07b-89e3-4b87-b93d-554748516b64 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:00.495897 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9ea2a07b-89e3-4b87-b93d-554748516b64 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:00.495897 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9ea2a07b-89e3-4b87-b93d-554748516b64 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:00.673630 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b2eaff43-42ee-4e89-ad51-081573fe5a0a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:00.690233 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b2eaff43-42ee-4e89-ad51-081573fe5a0a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1707 microversion: 2.1 time: 0.480046 Feb 19 02:29:00.690971 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 245/474] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:00 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1707 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:00.828626 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-3001a16a-5819-461d-a4fb-0da79b50f2ee tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:00.828626 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-3001a16a-5819-461d-a4fb-0da79b50f2ee tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: 87ce73f0-276b-4a23-9a93-51e8297cab10] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:00.843884 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3001a16a-5819-461d-a4fb-0da79b50f2ee tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:00.844405 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3001a16a-5819-461d-a4fb-0da79b50f2ee tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:00.845266 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3001a16a-5819-461d-a4fb-0da79b50f2ee tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:00.845768 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3001a16a-5819-461d-a4fb-0da79b50f2ee tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:00.847176 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9ea2a07b-89e3-4b87-b93d-554748516b64 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:00.859163 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-9ea2a07b-89e3-4b87-b93d-554748516b64 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1568 microversion: 2.1 time: 0.479862 Feb 19 02:29:00.880915 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 230/475] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:00 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1568 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:01.182859 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-3001a16a-5819-461d-a4fb-0da79b50f2ee tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:01.193087 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-3001a16a-5819-461d-a4fb-0da79b50f2ee tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10" status: 200 len: 1511 microversion: 2.1 time: 0.370742 Feb 19 02:29:01.193683 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 246/476] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:00 2021] GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10 => generated 1511 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:01.214621 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a15feb19-4186-47e5-91b6-29f10f275798 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:01.215302 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a15feb19-4186-47e5-91b6-29f10f275798 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:01.223812 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a15feb19-4186-47e5-91b6-29f10f275798 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:01.224333 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a15feb19-4186-47e5-91b6-29f10f275798 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:01.225173 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a15feb19-4186-47e5-91b6-29f10f275798 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:01.225668 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a15feb19-4186-47e5-91b6-29f10f275798 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:01.337360 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a9c8c235-d649-4d91-97d0-f9b6e11ee990 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:01.339959 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a9c8c235-d649-4d91-97d0-f9b6e11ee990 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] [instance: 87114f5c-f2da-4496-9d54-2eb9c3d28916] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:01.359619 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a9c8c235-d649-4d91-97d0-f9b6e11ee990 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:01.360052 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a9c8c235-d649-4d91-97d0-f9b6e11ee990 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:01.360911 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a9c8c235-d649-4d91-97d0-f9b6e11ee990 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:01.361401 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a9c8c235-d649-4d91-97d0-f9b6e11ee990 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:01.474384 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a15feb19-4186-47e5-91b6-29f10f275798 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:01.485449 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a15feb19-4186-47e5-91b6-29f10f275798 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:01.487076 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a15feb19-4186-47e5-91b6-29f10f275798 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:01.488499 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a15feb19-4186-47e5-91b6-29f10f275798 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1807 microversion: 2.20 time: 0.278569 Feb 19 02:29:01.489105 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 231/477] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:29:01 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1807 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 02:29:01.709496 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-079f4a47-eef4-47b4-9cab-13264e59fc26 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:01.710187 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-079f4a47-eef4-47b4-9cab-13264e59fc26 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:01.713735 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a9c8c235-d649-4d91-97d0-f9b6e11ee990 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593583d805ba40fe83595018ada8b386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43e163eccb44a118e6b89d19bdb5064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:01.723526 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-079f4a47-eef4-47b4-9cab-13264e59fc26 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:01.724571 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a9c8c235-d649-4d91-97d0-f9b6e11ee990 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] 10.222.0.44 "GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916" status: 200 len: 1469 microversion: 2.1 time: 0.393612 Feb 19 02:29:01.734954 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 247/478] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:01 2021] GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916 => generated 1469 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:01.736683 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-079f4a47-eef4-47b4-9cab-13264e59fc26 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:01.737682 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-079f4a47-eef4-47b4-9cab-13264e59fc26 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:01.738203 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-079f4a47-eef4-47b4-9cab-13264e59fc26 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:01.886914 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-da9a1d79-fe04-4fc0-ad81-3f1d4ac0eaaf tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:01.887575 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-da9a1d79-fe04-4fc0-ad81-3f1d4ac0eaaf tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:01.906498 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-da9a1d79-fe04-4fc0-ad81-3f1d4ac0eaaf tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:01.907077 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-da9a1d79-fe04-4fc0-ad81-3f1d4ac0eaaf tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:01.907944 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-da9a1d79-fe04-4fc0-ad81-3f1d4ac0eaaf tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:01.908447 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-da9a1d79-fe04-4fc0-ad81-3f1d4ac0eaaf tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:02.127028 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-079f4a47-eef4-47b4-9cab-13264e59fc26 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:02.140306 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-079f4a47-eef4-47b4-9cab-13264e59fc26 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1711 microversion: 2.1 time: 0.434600 Feb 19 02:29:02.165327 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 232/479] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:01 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1711 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:29:02.213058 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-67545038-a388-44a3-b188-d9e1da72c3c6 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:02.214113 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-67545038-a388-44a3-b188-d9e1da72c3c6 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: 87ce73f0-276b-4a23-9a93-51e8297cab10] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:02.222753 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-67545038-a388-44a3-b188-d9e1da72c3c6 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:02.223930 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-67545038-a388-44a3-b188-d9e1da72c3c6 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:02.225332 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-67545038-a388-44a3-b188-d9e1da72c3c6 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:02.227542 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-67545038-a388-44a3-b188-d9e1da72c3c6 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:02.294483 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-da9a1d79-fe04-4fc0-ad81-3f1d4ac0eaaf tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:02.306262 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-da9a1d79-fe04-4fc0-ad81-3f1d4ac0eaaf tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1568 microversion: 2.1 time: 0.423351 Feb 19 02:29:02.307217 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 248/480] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:01 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1568 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:02.516862 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-02957010-c978-4ed7-8f7a-c2ee4049ab12 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:02.518851 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-02957010-c978-4ed7-8f7a-c2ee4049ab12 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:02.539946 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-02957010-c978-4ed7-8f7a-c2ee4049ab12 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:02.539946 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-02957010-c978-4ed7-8f7a-c2ee4049ab12 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:02.539946 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-02957010-c978-4ed7-8f7a-c2ee4049ab12 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:02.539946 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-02957010-c978-4ed7-8f7a-c2ee4049ab12 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:02.612734 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-67545038-a388-44a3-b188-d9e1da72c3c6 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:02.631604 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-67545038-a388-44a3-b188-d9e1da72c3c6 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10" status: 200 len: 1511 microversion: 2.1 time: 0.423371 Feb 19 02:29:02.643224 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 233/481] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:02 2021] GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10 => generated 1511 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:02.745587 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ce585040-bbef-4eac-9950-9a4fde7e465d tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:02.748529 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ce585040-bbef-4eac-9950-9a4fde7e465d tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] [instance: 87114f5c-f2da-4496-9d54-2eb9c3d28916] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:02.771009 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ce585040-bbef-4eac-9950-9a4fde7e465d tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:02.771763 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ce585040-bbef-4eac-9950-9a4fde7e465d tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:02.773092 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ce585040-bbef-4eac-9950-9a4fde7e465d tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:02.774323 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ce585040-bbef-4eac-9950-9a4fde7e465d tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:02.879669 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-02957010-c978-4ed7-8f7a-c2ee4049ab12 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:02.898160 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-02957010-c978-4ed7-8f7a-c2ee4049ab12 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:02.900395 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-02957010-c978-4ed7-8f7a-c2ee4049ab12 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:02.901659 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-02957010-c978-4ed7-8f7a-c2ee4049ab12 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1807 microversion: 2.20 time: 0.395042 Feb 19 02:29:02.913718 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 249/482] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:29:02 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1807 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:29:03.096255 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ce585040-bbef-4eac-9950-9a4fde7e465d tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593583d805ba40fe83595018ada8b386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43e163eccb44a118e6b89d19bdb5064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:03.113711 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ce585040-bbef-4eac-9950-9a4fde7e465d tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] 10.222.0.44 "GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916" status: 200 len: 1469 microversion: 2.1 time: 0.372673 Feb 19 02:29:03.115800 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 234/483] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:02 2021] GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916 => generated 1469 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:03.346259 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5ad8df4b-b565-466f-bdf8-b7ab40100de4 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:03.347000 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5ad8df4b-b565-466f-bdf8-b7ab40100de4 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:03.365622 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5ad8df4b-b565-466f-bdf8-b7ab40100de4 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:03.366228 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5ad8df4b-b565-466f-bdf8-b7ab40100de4 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:03.372620 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5ad8df4b-b565-466f-bdf8-b7ab40100de4 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:03.373172 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5ad8df4b-b565-466f-bdf8-b7ab40100de4 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:03.651912 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-93220e2f-8324-427a-9721-21cf1bee78fa tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:03.652492 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-93220e2f-8324-427a-9721-21cf1bee78fa tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: 87ce73f0-276b-4a23-9a93-51e8297cab10] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:03.667814 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-93220e2f-8324-427a-9721-21cf1bee78fa tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:03.668589 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-93220e2f-8324-427a-9721-21cf1bee78fa tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:03.669767 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-93220e2f-8324-427a-9721-21cf1bee78fa tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:03.670438 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-93220e2f-8324-427a-9721-21cf1bee78fa tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:03.965522 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-93220e2f-8324-427a-9721-21cf1bee78fa tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:03.975624 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5ad8df4b-b565-466f-bdf8-b7ab40100de4 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:03.977096 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-93220e2f-8324-427a-9721-21cf1bee78fa tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10" status: 200 len: 1511 microversion: 2.1 time: 0.329751 Feb 19 02:29:03.978113 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 235/484] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:03 2021] GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10 => generated 1511 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:03.983726 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-53e65b97-168e-448d-b553-853ae528cfca tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:03.984598 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-53e65b97-168e-448d-b553-853ae528cfca tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:03.994178 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-53e65b97-168e-448d-b553-853ae528cfca tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:03.994899 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-53e65b97-168e-448d-b553-853ae528cfca tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:03.995920 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-53e65b97-168e-448d-b553-853ae528cfca tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:03.996051 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5ad8df4b-b565-466f-bdf8-b7ab40100de4 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1568 microversion: 2.1 time: 0.673948 Feb 19 02:29:03.996733 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-53e65b97-168e-448d-b553-853ae528cfca tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:03.997090 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 250/485] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:03 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1568 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:04.134138 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1c9e5b17-cc3b-4888-bc94-f0923ac7c1ac tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:04.135969 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1c9e5b17-cc3b-4888-bc94-f0923ac7c1ac tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] [instance: 87114f5c-f2da-4496-9d54-2eb9c3d28916] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:04.151636 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1c9e5b17-cc3b-4888-bc94-f0923ac7c1ac tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:04.154894 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1c9e5b17-cc3b-4888-bc94-f0923ac7c1ac tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:04.155943 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1c9e5b17-cc3b-4888-bc94-f0923ac7c1ac tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:04.167098 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1c9e5b17-cc3b-4888-bc94-f0923ac7c1ac tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:04.574023 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-53e65b97-168e-448d-b553-853ae528cfca tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:04.586297 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-53e65b97-168e-448d-b553-853ae528cfca tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:04.588251 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-53e65b97-168e-448d-b553-853ae528cfca tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:04.589802 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-53e65b97-168e-448d-b553-853ae528cfca tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1807 microversion: 2.20 time: 0.610333 Feb 19 02:29:04.591236 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 236/486] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:29:03 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1807 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:29:04.605877 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-1c9e5b17-cc3b-4888-bc94-f0923ac7c1ac tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593583d805ba40fe83595018ada8b386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43e163eccb44a118e6b89d19bdb5064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:04.615751 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1c9e5b17-cc3b-4888-bc94-f0923ac7c1ac tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] 10.222.0.44 "GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916" status: 200 len: 1469 microversion: 2.1 time: 0.486236 Feb 19 02:29:04.616432 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 251/487] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:04 2021] GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916 => generated 1469 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:29:05.004148 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4a07163b-ad75-4039-af54-df646136b02a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:05.008084 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-4a07163b-ad75-4039-af54-df646136b02a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: 87ce73f0-276b-4a23-9a93-51e8297cab10] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:05.028271 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c15bbe63-2db8-42ab-a9ba-cfb55351b6e4 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:05.029834 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c15bbe63-2db8-42ab-a9ba-cfb55351b6e4 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:05.060388 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4a07163b-ad75-4039-af54-df646136b02a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:05.072257 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4a07163b-ad75-4039-af54-df646136b02a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:05.076934 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4a07163b-ad75-4039-af54-df646136b02a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:05.080713 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c15bbe63-2db8-42ab-a9ba-cfb55351b6e4 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:05.081863 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4a07163b-ad75-4039-af54-df646136b02a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:05.095581 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c15bbe63-2db8-42ab-a9ba-cfb55351b6e4 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:05.097647 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c15bbe63-2db8-42ab-a9ba-cfb55351b6e4 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:05.098888 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c15bbe63-2db8-42ab-a9ba-cfb55351b6e4 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:05.614698 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c15bbe63-2db8-42ab-a9ba-cfb55351b6e4 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:05.627294 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c15bbe63-2db8-42ab-a9ba-cfb55351b6e4 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1568 microversion: 2.1 time: 0.610709 Feb 19 02:29:05.632350 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 252/488] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:05 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1568 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:05.647234 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-4a07163b-ad75-4039-af54-df646136b02a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:05.649856 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1a8e3ab1-4cf7-49e1-9e94-5d06043653e6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:05.654973 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1a8e3ab1-4cf7-49e1-9e94-5d06043653e6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:05.660645 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-4a07163b-ad75-4039-af54-df646136b02a tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10" status: 200 len: 1511 microversion: 2.1 time: 0.668416 Feb 19 02:29:05.661603 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 237/489] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:04 2021] GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10 => generated 1511 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:29:05.672400 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1a8e3ab1-4cf7-49e1-9e94-5d06043653e6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:05.676327 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1a8e3ab1-4cf7-49e1-9e94-5d06043653e6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:05.677363 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1a8e3ab1-4cf7-49e1-9e94-5d06043653e6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:05.677974 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1a8e3ab1-4cf7-49e1-9e94-5d06043653e6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:05.678798 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-37beda08-13fc-4e40-ad6b-46865735a2bf tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:05.679622 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-37beda08-13fc-4e40-ad6b-46865735a2bf tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] [instance: 87114f5c-f2da-4496-9d54-2eb9c3d28916] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:05.689965 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-37beda08-13fc-4e40-ad6b-46865735a2bf tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:05.690812 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-37beda08-13fc-4e40-ad6b-46865735a2bf tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:05.691830 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-37beda08-13fc-4e40-ad6b-46865735a2bf tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:05.692468 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-37beda08-13fc-4e40-ad6b-46865735a2bf tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:06.019836 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-1a8e3ab1-4cf7-49e1-9e94-5d06043653e6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:06.029361 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-37beda08-13fc-4e40-ad6b-46865735a2bf tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593583d805ba40fe83595018ada8b386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43e163eccb44a118e6b89d19bdb5064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:06.038072 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-37beda08-13fc-4e40-ad6b-46865735a2bf tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] 10.222.0.44 "GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916" status: 200 len: 1469 microversion: 2.1 time: 0.363703 Feb 19 02:29:06.043291 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 238/490] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:05 2021] GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916 => generated 1469 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:06.064734 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-1a8e3ab1-4cf7-49e1-9e94-5d06043653e6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:06.068827 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-1a8e3ab1-4cf7-49e1-9e94-5d06043653e6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:06.080398 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1a8e3ab1-4cf7-49e1-9e94-5d06043653e6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1807 microversion: 2.20 time: 0.444955 Feb 19 02:29:06.092975 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 253/491] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:29:05 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1807 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:29:06.494001 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-211c19c2-2583-42b5-ae50-7e17de2a7334 req-ebcf7939-c712-41be-aa98-e371cb632e40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87114f5c-f2da-4496-9d54-2eb9c3d28916", "name": "network-vif-unplugged", "status": "completed", "tag": "f816b76e-b1f2-4310-aa5d-8e11af558a98"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:29:06.496037 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:29:06.496037 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:29:06.510673 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-211c19c2-2583-42b5-ae50-7e17de2a7334 req-ebcf7939-c712-41be-aa98-e371cb632e40 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:06.511337 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-211c19c2-2583-42b5-ae50-7e17de2a7334 req-ebcf7939-c712-41be-aa98-e371cb632e40 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:06.530618 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-211c19c2-2583-42b5-ae50-7e17de2a7334 req-ebcf7939-c712-41be-aa98-e371cb632e40 service nova] Creating event network-vif-unplugged:f816b76e-b1f2-4310-aa5d-8e11af558a98 for instance 87114f5c-f2da-4496-9d54-2eb9c3d28916 on hv-cinder-77642 Feb 19 02:29:06.538174 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-211c19c2-2583-42b5-ae50-7e17de2a7334 req-ebcf7939-c712-41be-aa98-e371cb632e40 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048835 Feb 19 02:29:06.538850 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 239/492] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:29:06 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:29:06.647306 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-980bc695-948d-4cec-be14-ed3e43cb1fbb tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:06.647984 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-980bc695-948d-4cec-be14-ed3e43cb1fbb tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:06.656618 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-980bc695-948d-4cec-be14-ed3e43cb1fbb tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:06.657133 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-980bc695-948d-4cec-be14-ed3e43cb1fbb tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:06.657975 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-980bc695-948d-4cec-be14-ed3e43cb1fbb tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:06.658495 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-980bc695-948d-4cec-be14-ed3e43cb1fbb tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:06.681076 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e2b0a413-c37b-4f31-8621-d7339e5f9e81 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:06.681852 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e2b0a413-c37b-4f31-8621-d7339e5f9e81 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: 87ce73f0-276b-4a23-9a93-51e8297cab10] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:06.690128 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e2b0a413-c37b-4f31-8621-d7339e5f9e81 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:06.690700 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e2b0a413-c37b-4f31-8621-d7339e5f9e81 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:06.691551 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e2b0a413-c37b-4f31-8621-d7339e5f9e81 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:06.692051 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e2b0a413-c37b-4f31-8621-d7339e5f9e81 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:06.901715 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-980bc695-948d-4cec-be14-ed3e43cb1fbb tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:06.912527 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-980bc695-948d-4cec-be14-ed3e43cb1fbb tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1568 microversion: 2.1 time: 0.269122 Feb 19 02:29:06.913526 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 254/493] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:06 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1568 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:06.938465 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e2b0a413-c37b-4f31-8621-d7339e5f9e81 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:06.949143 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e2b0a413-c37b-4f31-8621-d7339e5f9e81 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10" status: 200 len: 1511 microversion: 2.1 time: 0.272719 Feb 19 02:29:06.950222 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 240/494] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:06 2021] GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10 => generated 1511 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:07.061350 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ab1c2ae8-e7eb-4775-a3b4-d5a2f8ab50e5 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:07.062775 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ab1c2ae8-e7eb-4775-a3b4-d5a2f8ab50e5 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] [instance: 87114f5c-f2da-4496-9d54-2eb9c3d28916] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:07.072329 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ab1c2ae8-e7eb-4775-a3b4-d5a2f8ab50e5 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:07.073331 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ab1c2ae8-e7eb-4775-a3b4-d5a2f8ab50e5 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:07.074242 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ab1c2ae8-e7eb-4775-a3b4-d5a2f8ab50e5 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:07.074969 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ab1c2ae8-e7eb-4775-a3b4-d5a2f8ab50e5 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:07.102825 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c9d3459c-5364-4fee-8484-c7d4920c0e5b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:07.103505 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c9d3459c-5364-4fee-8484-c7d4920c0e5b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:07.113283 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c9d3459c-5364-4fee-8484-c7d4920c0e5b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:07.113695 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c9d3459c-5364-4fee-8484-c7d4920c0e5b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:07.115083 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c9d3459c-5364-4fee-8484-c7d4920c0e5b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:07.115823 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c9d3459c-5364-4fee-8484-c7d4920c0e5b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:07.414149 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ab1c2ae8-e7eb-4775-a3b4-d5a2f8ab50e5 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593583d805ba40fe83595018ada8b386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43e163eccb44a118e6b89d19bdb5064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:07.423980 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ab1c2ae8-e7eb-4775-a3b4-d5a2f8ab50e5 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] 10.222.0.44 "GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916" status: 200 len: 1469 microversion: 2.1 time: 0.366693 Feb 19 02:29:07.424837 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 255/495] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:07 2021] GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916 => generated 1469 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:07.460242 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c9d3459c-5364-4fee-8484-c7d4920c0e5b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:07.473540 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c9d3459c-5364-4fee-8484-c7d4920c0e5b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:07.475214 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c9d3459c-5364-4fee-8484-c7d4920c0e5b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:07.476478 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c9d3459c-5364-4fee-8484-c7d4920c0e5b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1807 microversion: 2.20 time: 0.379324 Feb 19 02:29:07.477687 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 241/496] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:29:07 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1807 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 02:29:07.932531 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ff5f3131-c405-477a-81a2-f0aa4213b8ad tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:07.933724 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ff5f3131-c405-477a-81a2-f0aa4213b8ad tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:07.942174 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ff5f3131-c405-477a-81a2-f0aa4213b8ad tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:07.942723 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ff5f3131-c405-477a-81a2-f0aa4213b8ad tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:07.943864 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ff5f3131-c405-477a-81a2-f0aa4213b8ad tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:07.944367 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ff5f3131-c405-477a-81a2-f0aa4213b8ad tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:07.969431 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ac7f21c2-a962-43f6-880d-97d259663b56 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:07.970486 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ac7f21c2-a962-43f6-880d-97d259663b56 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: 87ce73f0-276b-4a23-9a93-51e8297cab10] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:07.980901 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ac7f21c2-a962-43f6-880d-97d259663b56 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:07.981725 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ac7f21c2-a962-43f6-880d-97d259663b56 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:07.982934 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ac7f21c2-a962-43f6-880d-97d259663b56 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:07.983787 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ac7f21c2-a962-43f6-880d-97d259663b56 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:08.263321 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ff5f3131-c405-477a-81a2-f0aa4213b8ad tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:08.274836 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ff5f3131-c405-477a-81a2-f0aa4213b8ad tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1568 microversion: 2.1 time: 0.346763 Feb 19 02:29:08.275491 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 256/497] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:07 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1568 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:08.442457 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4dbeb335-90cd-44c6-b1fd-6b753ab7fb04 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:08.443137 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-4dbeb335-90cd-44c6-b1fd-6b753ab7fb04 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] [instance: 87114f5c-f2da-4496-9d54-2eb9c3d28916] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:08.451749 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4dbeb335-90cd-44c6-b1fd-6b753ab7fb04 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:08.452254 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4dbeb335-90cd-44c6-b1fd-6b753ab7fb04 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:08.453104 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4dbeb335-90cd-44c6-b1fd-6b753ab7fb04 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:08.453590 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4dbeb335-90cd-44c6-b1fd-6b753ab7fb04 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:08.667528 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ac7f21c2-a962-43f6-880d-97d259663b56 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:08.678135 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ac7f21c2-a962-43f6-880d-97d259663b56 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10" status: 200 len: 1511 microversion: 2.1 time: 0.713410 Feb 19 02:29:08.678988 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 242/498] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:07 2021] GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10 => generated 1511 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:08.685549 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-dd147192-8011-4cd9-990e-0e9a82f1ed10 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:08.686415 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-dd147192-8011-4cd9-990e-0e9a82f1ed10 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:08.694841 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dd147192-8011-4cd9-990e-0e9a82f1ed10 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:08.695392 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dd147192-8011-4cd9-990e-0e9a82f1ed10 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:08.696317 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dd147192-8011-4cd9-990e-0e9a82f1ed10 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:08.696813 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dd147192-8011-4cd9-990e-0e9a82f1ed10 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:08.900912 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-4dbeb335-90cd-44c6-b1fd-6b753ab7fb04 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593583d805ba40fe83595018ada8b386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43e163eccb44a118e6b89d19bdb5064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:08.936684 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-4dbeb335-90cd-44c6-b1fd-6b753ab7fb04 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] 10.222.0.44 "GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916" status: 200 len: 1469 microversion: 2.1 time: 0.498259 Feb 19 02:29:08.937639 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 257/499] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:08 2021] GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916 => generated 1469 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:29:09.293227 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-34306845-c242-4c16-bb8e-80575849771b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:09.295070 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-34306845-c242-4c16-bb8e-80575849771b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:09.302705 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-34306845-c242-4c16-bb8e-80575849771b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:09.303216 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-34306845-c242-4c16-bb8e-80575849771b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:09.304276 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-34306845-c242-4c16-bb8e-80575849771b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:09.304808 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-34306845-c242-4c16-bb8e-80575849771b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:09.545060 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-dd147192-8011-4cd9-990e-0e9a82f1ed10 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:09.572128 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-dd147192-8011-4cd9-990e-0e9a82f1ed10 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:09.582048 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-dd147192-8011-4cd9-990e-0e9a82f1ed10 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:09.602883 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-dd147192-8011-4cd9-990e-0e9a82f1ed10 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1807 microversion: 2.20 time: 0.920840 Feb 19 02:29:09.606098 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 243/500] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:29:08 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1807 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:29:09.696908 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e1bc3995-e7a6-4fdc-98c5-ccc74c97a1fc tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:09.697593 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e1bc3995-e7a6-4fdc-98c5-ccc74c97a1fc tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: 87ce73f0-276b-4a23-9a93-51e8297cab10] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:09.706458 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e1bc3995-e7a6-4fdc-98c5-ccc74c97a1fc tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:09.707314 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e1bc3995-e7a6-4fdc-98c5-ccc74c97a1fc tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:09.708367 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e1bc3995-e7a6-4fdc-98c5-ccc74c97a1fc tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:09.709040 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e1bc3995-e7a6-4fdc-98c5-ccc74c97a1fc tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:09.836294 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-34306845-c242-4c16-bb8e-80575849771b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:09.848654 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-34306845-c242-4c16-bb8e-80575849771b tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1568 microversion: 2.1 time: 0.559687 Feb 19 02:29:09.849289 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 258/501] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:09 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1568 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:29:09.960547 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-46788187-bb90-4327-9d6d-bfdce1b99685 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:09.961578 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-46788187-bb90-4327-9d6d-bfdce1b99685 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] [instance: 87114f5c-f2da-4496-9d54-2eb9c3d28916] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:09.984635 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-46788187-bb90-4327-9d6d-bfdce1b99685 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:09.989481 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-46788187-bb90-4327-9d6d-bfdce1b99685 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:09.990680 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-46788187-bb90-4327-9d6d-bfdce1b99685 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:09.991803 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-46788187-bb90-4327-9d6d-bfdce1b99685 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:10.210702 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-46788187-bb90-4327-9d6d-bfdce1b99685 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593583d805ba40fe83595018ada8b386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c43e163eccb44a118e6b89d19bdb5064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:10.222121 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-46788187-bb90-4327-9d6d-bfdce1b99685 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] 10.222.0.44 "GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916" status: 200 len: 1427 microversion: 2.1 time: 0.268989 Feb 19 02:29:10.230550 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 259/502] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:09 2021] GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916 => generated 1427 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:10.390307 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e1bc3995-e7a6-4fdc-98c5-ccc74c97a1fc tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:10.409402 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e1bc3995-e7a6-4fdc-98c5-ccc74c97a1fc tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10" status: 200 len: 1511 microversion: 2.1 time: 0.716461 Feb 19 02:29:10.411073 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 244/503] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:09 2021] GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10 => generated 1511 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:29:10.549702 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-de370905-e0a5-49cb-a75a-86749e397f9a req-99e801f9-6c34-4bb0-9af2-e5e25fc71206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87114f5c-f2da-4496-9d54-2eb9c3d28916", "name": "network-vif-deleted", "tag": "f816b76e-b1f2-4310-aa5d-8e11af558a98"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:29:10.551702 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:29:10.551702 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:29:10.576506 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-de370905-e0a5-49cb-a75a-86749e397f9a req-99e801f9-6c34-4bb0-9af2-e5e25fc71206 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:10.577298 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-de370905-e0a5-49cb-a75a-86749e397f9a req-99e801f9-6c34-4bb0-9af2-e5e25fc71206 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:10.597862 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-de370905-e0a5-49cb-a75a-86749e397f9a req-99e801f9-6c34-4bb0-9af2-e5e25fc71206 service nova] Creating event network-vif-deleted:f816b76e-b1f2-4310-aa5d-8e11af558a98 for instance 87114f5c-f2da-4496-9d54-2eb9c3d28916 on hv-cinder-77642 Feb 19 02:29:10.606470 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-de370905-e0a5-49cb-a75a-86749e397f9a req-99e801f9-6c34-4bb0-9af2-e5e25fc71206 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060590 Feb 19 02:29:10.607468 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 260/504] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:29:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:29:10.627782 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b8c21ba8-c2c2-4a77-83d6-5d3d5795d83d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:10.632219 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b8c21ba8-c2c2-4a77-83d6-5d3d5795d83d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:10.643387 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b8c21ba8-c2c2-4a77-83d6-5d3d5795d83d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:10.644135 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b8c21ba8-c2c2-4a77-83d6-5d3d5795d83d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:10.645849 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b8c21ba8-c2c2-4a77-83d6-5d3d5795d83d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:10.646693 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b8c21ba8-c2c2-4a77-83d6-5d3d5795d83d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:10.875745 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-559d88ae-41a2-413c-a330-6eacb3b25019 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:10.876929 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-559d88ae-41a2-413c-a330-6eacb3b25019 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:10.885953 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-559d88ae-41a2-413c-a330-6eacb3b25019 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:10.904497 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-559d88ae-41a2-413c-a330-6eacb3b25019 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:10.905865 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-559d88ae-41a2-413c-a330-6eacb3b25019 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:10.907777 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-559d88ae-41a2-413c-a330-6eacb3b25019 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:10.932455 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b8c21ba8-c2c2-4a77-83d6-5d3d5795d83d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:10.944990 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b8c21ba8-c2c2-4a77-83d6-5d3d5795d83d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:10.947303 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b8c21ba8-c2c2-4a77-83d6-5d3d5795d83d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:10.948772 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b8c21ba8-c2c2-4a77-83d6-5d3d5795d83d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1807 microversion: 2.20 time: 0.327915 Feb 19 02:29:10.949888 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 245/505] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:29:10 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1807 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:29:11.241699 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-6b85523e-7a5d-441e-8419-e9e74e92ae77 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:11.242869 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-6b85523e-7a5d-441e-8419-e9e74e92ae77 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] [instance: 87114f5c-f2da-4496-9d54-2eb9c3d28916] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:11.251567 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6b85523e-7a5d-441e-8419-e9e74e92ae77 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:11.252075 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6b85523e-7a5d-441e-8419-e9e74e92ae77 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:11.253255 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6b85523e-7a5d-441e-8419-e9e74e92ae77 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:11.253756 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6b85523e-7a5d-441e-8419-e9e74e92ae77 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:11.311194 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-6b85523e-7a5d-441e-8419-e9e74e92ae77 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] HTTP exception thrown: Instance 87114f5c-f2da-4496-9d54-2eb9c3d28916 could not be found. Feb 19 02:29:11.311875 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-6b85523e-7a5d-441e-8419-e9e74e92ae77 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] Returning 404 to user: Instance 87114f5c-f2da-4496-9d54-2eb9c3d28916 could not be found. {{(pid=98194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:29:11.312804 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-6b85523e-7a5d-441e-8419-e9e74e92ae77 tempest-VolumesNegativeTest-1959634257 tempest-VolumesNegativeTest-1959634257-project] 10.222.0.44 "GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916" status: 404 len: 111 microversion: 2.1 time: 0.075270 Feb 19 02:29:11.313448 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 246/506] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:11 2021] GET /compute/v2.1/servers/87114f5c-f2da-4496-9d54-2eb9c3d28916 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 02:29:11.432928 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ae8dc8bc-c1ea-4a8e-9667-bfb7684fd172 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:11.435084 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ae8dc8bc-c1ea-4a8e-9667-bfb7684fd172 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: 87ce73f0-276b-4a23-9a93-51e8297cab10] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:11.446130 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ae8dc8bc-c1ea-4a8e-9667-bfb7684fd172 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:11.446792 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ae8dc8bc-c1ea-4a8e-9667-bfb7684fd172 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:11.448839 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ae8dc8bc-c1ea-4a8e-9667-bfb7684fd172 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:11.449579 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ae8dc8bc-c1ea-4a8e-9667-bfb7684fd172 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:11.556980 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ae8dc8bc-c1ea-4a8e-9667-bfb7684fd172 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:11.557460 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ae8dc8bc-c1ea-4a8e-9667-bfb7684fd172 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:11.558067 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.objects.instance [None req-ae8dc8bc-c1ea-4a8e-9667-bfb7684fd172 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lazy-loading 'fault' on Instance uuid 87ce73f0-276b-4a23-9a93-51e8297cab10 {{(pid=98194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 02:29:11.688357 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ae8dc8bc-c1ea-4a8e-9667-bfb7684fd172 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:11.697006 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ae8dc8bc-c1ea-4a8e-9667-bfb7684fd172 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10" status: 200 len: 1308 microversion: 2.1 time: 0.271675 Feb 19 02:29:11.697605 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 247/507] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:11 2021] GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10 => generated 1308 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:11.722598 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-559d88ae-41a2-413c-a330-6eacb3b25019 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:11.733464 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-559d88ae-41a2-413c-a330-6eacb3b25019 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1548 microversion: 2.1 time: 0.868956 Feb 19 02:29:11.734127 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 261/508] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:10 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1548 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:11.751826 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-aeffa0a2-fb12-4bfc-8e5c-b8b526dd38ba tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:11.752380 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-aeffa0a2-fb12-4bfc-8e5c-b8b526dd38ba tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:11.760884 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-aeffa0a2-fb12-4bfc-8e5c-b8b526dd38ba tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:11.761395 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-aeffa0a2-fb12-4bfc-8e5c-b8b526dd38ba tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:11.762388 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-aeffa0a2-fb12-4bfc-8e5c-b8b526dd38ba tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:11.762993 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-aeffa0a2-fb12-4bfc-8e5c-b8b526dd38ba tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:11.954669 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-aeffa0a2-fb12-4bfc-8e5c-b8b526dd38ba tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] HTTP exception thrown: Cannot 'detach_volume' instance c0a55cfa-c2c0-48e5-b519-53c9b68c38cd while it is in vm_state rescued Feb 19 02:29:11.956434 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-aeffa0a2-fb12-4bfc-8e5c-b8b526dd38ba tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Returning 409 to user: Cannot 'detach_volume' instance c0a55cfa-c2c0-48e5-b519-53c9b68c38cd while it is in vm_state rescued {{(pid=98194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:29:11.957200 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-aeffa0a2-fb12-4bfc-8e5c-b8b526dd38ba tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd/os-volume_attachments/bca9cd62-15ee-4a4a-b207-14630f27db14" status: 409 len: 152 microversion: 2.1 time: 0.209562 Feb 19 02:29:11.958003 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 248/509] 10.222.0.44 () {58 vars in 1406 bytes} [Fri Feb 19 02:29:11 2021] DELETE /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd/os-volume_attachments/bca9cd62-15ee-4a4a-b207-14630f27db14 => generated 152 bytes in 211 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 19 02:29:11.968269 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c471650c-68ab-4edf-b9db-cd4afcc1ac35 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:29:11.968871 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c471650c-68ab-4edf-b9db-cd4afcc1ac35 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:11.982234 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c471650c-68ab-4edf-b9db-cd4afcc1ac35 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:11.982806 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c471650c-68ab-4edf-b9db-cd4afcc1ac35 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:11.983106 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d7b441b4-f783-44b8-8f02-a057c16cd9c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:11.983680 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c471650c-68ab-4edf-b9db-cd4afcc1ac35 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:11.984181 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c471650c-68ab-4edf-b9db-cd4afcc1ac35 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:11.984663 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d7b441b4-f783-44b8-8f02-a057c16cd9c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:11.995974 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d7b441b4-f783-44b8-8f02-a057c16cd9c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:11.996664 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d7b441b4-f783-44b8-8f02-a057c16cd9c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:11.997697 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d7b441b4-f783-44b8-8f02-a057c16cd9c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:11.998336 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d7b441b4-f783-44b8-8f02-a057c16cd9c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:12.164361 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c471650c-68ab-4edf-b9db-cd4afcc1ac35 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "POST /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd/action" status: 202 len: 0 microversion: 2.1 time: 0.200355 Feb 19 02:29:12.165181 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 262/510] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:29:11 2021] POST /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:29:12.176010 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7352748c-9643-44e3-9c89-33afaf5a9e44 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:12.177498 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7352748c-9643-44e3-9c89-33afaf5a9e44 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:12.206686 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7352748c-9643-44e3-9c89-33afaf5a9e44 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:12.207762 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7352748c-9643-44e3-9c89-33afaf5a9e44 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:12.209348 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7352748c-9643-44e3-9c89-33afaf5a9e44 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:12.210006 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7352748c-9643-44e3-9c89-33afaf5a9e44 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:12.299591 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-d7b441b4-f783-44b8-8f02-a057c16cd9c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:12.311629 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-d7b441b4-f783-44b8-8f02-a057c16cd9c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:12.313635 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-d7b441b4-f783-44b8-8f02-a057c16cd9c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:12.315518 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d7b441b4-f783-44b8-8f02-a057c16cd9c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1807 microversion: 2.20 time: 0.340747 Feb 19 02:29:12.316628 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 249/511] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:29:11 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1807 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:29:12.506401 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7352748c-9643-44e3-9c89-33afaf5a9e44 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:12.517000 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7352748c-9643-44e3-9c89-33afaf5a9e44 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1556 microversion: 2.1 time: 0.346394 Feb 19 02:29:12.517629 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 263/512] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:12 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1556 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:12.661415 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-bb691062-3fea-4605-be37-c05d1251da5a req-7b7eb76a-2c81-43e0-9be8-9574c0ad63f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87ce73f0-276b-4a23-9a93-51e8297cab10", "name": "network-vif-deleted", "tag": "50be1d4c-77b6-44fb-8fab-6f239ccc76c3"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:29:12.665127 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:29:12.665127 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:29:12.674440 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-bb691062-3fea-4605-be37-c05d1251da5a req-7b7eb76a-2c81-43e0-9be8-9574c0ad63f8 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:12.674950 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-bb691062-3fea-4605-be37-c05d1251da5a req-7b7eb76a-2c81-43e0-9be8-9574c0ad63f8 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:12.697662 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-bb691062-3fea-4605-be37-c05d1251da5a req-7b7eb76a-2c81-43e0-9be8-9574c0ad63f8 service nova] Creating event network-vif-deleted:50be1d4c-77b6-44fb-8fab-6f239ccc76c3 for instance 87ce73f0-276b-4a23-9a93-51e8297cab10 on hv-cinder-77642 Feb 19 02:29:12.707384 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-bb691062-3fea-4605-be37-c05d1251da5a req-7b7eb76a-2c81-43e0-9be8-9574c0ad63f8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051507 Feb 19 02:29:12.708339 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 250/513] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:29:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:29:12.718043 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d080ad27-825d-4692-8584-285a07a4b229 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:12.718982 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d080ad27-825d-4692-8584-285a07a4b229 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: 87ce73f0-276b-4a23-9a93-51e8297cab10] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:12.728319 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d080ad27-825d-4692-8584-285a07a4b229 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:12.728935 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d080ad27-825d-4692-8584-285a07a4b229 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:12.730263 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d080ad27-825d-4692-8584-285a07a4b229 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:12.731037 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d080ad27-825d-4692-8584-285a07a4b229 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:12.792176 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-d080ad27-825d-4692-8584-285a07a4b229 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] HTTP exception thrown: Instance 87ce73f0-276b-4a23-9a93-51e8297cab10 could not be found. Feb 19 02:29:12.793440 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d080ad27-825d-4692-8584-285a07a4b229 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Returning 404 to user: Instance 87ce73f0-276b-4a23-9a93-51e8297cab10 could not be found. {{(pid=98193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:29:12.794973 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d080ad27-825d-4692-8584-285a07a4b229 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10" status: 404 len: 111 microversion: 2.1 time: 0.081291 Feb 19 02:29:12.797264 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 264/514] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:12 2021] GET /compute/v2.1/servers/87ce73f0-276b-4a23-9a93-51e8297cab10 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 02:29:12.807635 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f5e8e3b5-ad1a-461a-b460-306279a8b0f6 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:12.808729 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f5e8e3b5-ad1a-461a-b460-306279a8b0f6 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:12.818330 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f5e8e3b5-ad1a-461a-b460-306279a8b0f6 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:12.819129 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f5e8e3b5-ad1a-461a-b460-306279a8b0f6 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:12.820232 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f5e8e3b5-ad1a-461a-b460-306279a8b0f6 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:12.820904 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f5e8e3b5-ad1a-461a-b460-306279a8b0f6 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:12.905497 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f5e8e3b5-ad1a-461a-b460-306279a8b0f6 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4] Going to try to terminate instance {{(pid=98194) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 02:29:13.057786 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f5e8e3b5-ad1a-461a-b460-306279a8b0f6 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "DELETE /compute/v2.1/servers/cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4" status: 204 len: 0 microversion: 2.1 time: 0.255672 Feb 19 02:29:13.058511 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 251/515] 10.222.0.44 () {58 vars in 1229 bytes} [Fri Feb 19 02:29:12 2021] DELETE /compute/v2.1/servers/cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 19 02:29:13.067679 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-08e5ca45-171a-417a-a799-ea5ff7704435 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:13.068220 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-08e5ca45-171a-417a-a799-ea5ff7704435 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:13.082042 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-08e5ca45-171a-417a-a799-ea5ff7704435 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:13.082794 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-08e5ca45-171a-417a-a799-ea5ff7704435 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:13.084605 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-08e5ca45-171a-417a-a799-ea5ff7704435 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:13.085258 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-08e5ca45-171a-417a-a799-ea5ff7704435 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:13.346329 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-2f511d46-3dce-4022-910b-00c076dd33a7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:13.354702 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-2f511d46-3dce-4022-910b-00c076dd33a7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:13.369388 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-08e5ca45-171a-417a-a799-ea5ff7704435 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:13.370104 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2f511d46-3dce-4022-910b-00c076dd33a7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:13.371471 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2f511d46-3dce-4022-910b-00c076dd33a7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:13.373711 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2f511d46-3dce-4022-910b-00c076dd33a7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:13.375520 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2f511d46-3dce-4022-910b-00c076dd33a7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:13.382459 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-08e5ca45-171a-417a-a799-ea5ff7704435 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4" status: 200 len: 1511 microversion: 2.1 time: 0.318944 Feb 19 02:29:13.383963 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 265/516] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:13 2021] GET /compute/v2.1/servers/cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4 => generated 1511 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:29:13.537540 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ae931e19-2a57-465e-8fa7-8a39c1e36835 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:13.538181 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ae931e19-2a57-465e-8fa7-8a39c1e36835 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:13.546953 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ae931e19-2a57-465e-8fa7-8a39c1e36835 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:13.548225 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ae931e19-2a57-465e-8fa7-8a39c1e36835 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:13.549371 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ae931e19-2a57-465e-8fa7-8a39c1e36835 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:13.550010 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ae931e19-2a57-465e-8fa7-8a39c1e36835 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:13.649644 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-2f511d46-3dce-4022-910b-00c076dd33a7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:13.661680 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-2f511d46-3dce-4022-910b-00c076dd33a7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:13.663763 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-2f511d46-3dce-4022-910b-00c076dd33a7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:13.665587 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-2f511d46-3dce-4022-910b-00c076dd33a7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1807 microversion: 2.20 time: 0.323856 Feb 19 02:29:13.677782 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 252/517] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:29:13 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1807 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:29:13.808171 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ae931e19-2a57-465e-8fa7-8a39c1e36835 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:13.827428 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ae931e19-2a57-465e-8fa7-8a39c1e36835 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1556 microversion: 2.1 time: 0.294699 Feb 19 02:29:13.828684 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 266/518] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:13 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1556 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:29:14.402331 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d162ea45-e1a4-4e46-b1d8-39926bac157e tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:14.403152 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d162ea45-e1a4-4e46-b1d8-39926bac157e tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:14.411590 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d162ea45-e1a4-4e46-b1d8-39926bac157e tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:14.412410 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d162ea45-e1a4-4e46-b1d8-39926bac157e tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:14.413405 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d162ea45-e1a4-4e46-b1d8-39926bac157e tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:14.414041 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d162ea45-e1a4-4e46-b1d8-39926bac157e tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:14.686276 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7720bd95-38fa-4e52-845c-a9068d74c58b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:14.687448 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7720bd95-38fa-4e52-845c-a9068d74c58b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:14.697313 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7720bd95-38fa-4e52-845c-a9068d74c58b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:14.697712 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7720bd95-38fa-4e52-845c-a9068d74c58b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:14.698753 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7720bd95-38fa-4e52-845c-a9068d74c58b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:14.699568 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7720bd95-38fa-4e52-845c-a9068d74c58b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:14.884124 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-d162ea45-e1a4-4e46-b1d8-39926bac157e tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:14.894862 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d162ea45-e1a4-4e46-b1d8-39926bac157e tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4" status: 200 len: 1511 microversion: 2.1 time: 0.497272 Feb 19 02:29:14.895839 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 253/519] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:14 2021] GET /compute/v2.1/servers/cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4 => generated 1511 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:14.900778 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-9ae95809-2967-49a9-b97e-d86ddce97796 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:14.901684 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-9ae95809-2967-49a9-b97e-d86ddce97796 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:14.910139 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9ae95809-2967-49a9-b97e-d86ddce97796 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:14.911029 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9ae95809-2967-49a9-b97e-d86ddce97796 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:14.926770 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9ae95809-2967-49a9-b97e-d86ddce97796 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:14.927878 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9ae95809-2967-49a9-b97e-d86ddce97796 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:14.977356 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7720bd95-38fa-4e52-845c-a9068d74c58b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:14.995414 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7720bd95-38fa-4e52-845c-a9068d74c58b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:15.004598 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7720bd95-38fa-4e52-845c-a9068d74c58b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:15.011887 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7720bd95-38fa-4e52-845c-a9068d74c58b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1807 microversion: 2.20 time: 0.329773 Feb 19 02:29:15.013134 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 267/520] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:29:14 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1807 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:29:15.594604 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9ae95809-2967-49a9-b97e-d86ddce97796 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:15.609183 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-9ae95809-2967-49a9-b97e-d86ddce97796 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1556 microversion: 2.1 time: 0.712008 Feb 19 02:29:15.609924 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 254/521] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:14 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1556 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:15.913827 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5de97c33-3a80-4706-9ce8-e99e0340b77b tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:15.915119 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5de97c33-3a80-4706-9ce8-e99e0340b77b tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:15.923704 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5de97c33-3a80-4706-9ce8-e99e0340b77b tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:15.924593 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5de97c33-3a80-4706-9ce8-e99e0340b77b tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:15.925831 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5de97c33-3a80-4706-9ce8-e99e0340b77b tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:15.926557 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5de97c33-3a80-4706-9ce8-e99e0340b77b tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:16.034906 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5471a31d-0292-40a1-a9ab-82bf32fedf51 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:16.035998 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5471a31d-0292-40a1-a9ab-82bf32fedf51 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:16.054965 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5471a31d-0292-40a1-a9ab-82bf32fedf51 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:16.057376 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5471a31d-0292-40a1-a9ab-82bf32fedf51 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:16.058438 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5471a31d-0292-40a1-a9ab-82bf32fedf51 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:16.058952 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5471a31d-0292-40a1-a9ab-82bf32fedf51 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:16.241505 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5de97c33-3a80-4706-9ce8-e99e0340b77b tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:16.251514 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5de97c33-3a80-4706-9ce8-e99e0340b77b tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4" status: 200 len: 1469 microversion: 2.1 time: 0.341875 Feb 19 02:29:16.252250 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 268/522] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:15 2021] GET /compute/v2.1/servers/cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4 => generated 1469 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:16.257350 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-e6f6b05f-14ef-4912-af10-5321d5b26383 req-02d53275-673a-4646-87d3-f530de7608b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4", "name": "network-vif-deleted", "tag": "278e34f1-4ef8-45d9-9318-24113c70b71c"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:29:16.259818 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:29:16.259818 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:29:16.269074 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-e6f6b05f-14ef-4912-af10-5321d5b26383 req-02d53275-673a-4646-87d3-f530de7608b8 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:16.269570 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-e6f6b05f-14ef-4912-af10-5321d5b26383 req-02d53275-673a-4646-87d3-f530de7608b8 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:16.287439 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-e6f6b05f-14ef-4912-af10-5321d5b26383 req-02d53275-673a-4646-87d3-f530de7608b8 service nova] Creating event network-vif-deleted:278e34f1-4ef8-45d9-9318-24113c70b71c for instance cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4 on hv-cinder-77642 Feb 19 02:29:16.292542 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-e6f6b05f-14ef-4912-af10-5321d5b26383 req-02d53275-673a-4646-87d3-f530de7608b8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038824 Feb 19 02:29:16.293741 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 269/523] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:29:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:29:16.321205 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5471a31d-0292-40a1-a9ab-82bf32fedf51 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:16.332036 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5471a31d-0292-40a1-a9ab-82bf32fedf51 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:16.334577 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5471a31d-0292-40a1-a9ab-82bf32fedf51 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:16.334880 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5471a31d-0292-40a1-a9ab-82bf32fedf51 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1807 microversion: 2.20 time: 0.305876 Feb 19 02:29:16.335508 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 255/524] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:29:16 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1807 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:29:16.628791 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1dc7afc5-a6c6-4b74-b5e3-bd7636f5245a tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:16.629769 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1dc7afc5-a6c6-4b74-b5e3-bd7636f5245a tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:16.638274 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1dc7afc5-a6c6-4b74-b5e3-bd7636f5245a tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:16.638990 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1dc7afc5-a6c6-4b74-b5e3-bd7636f5245a tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:16.640010 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1dc7afc5-a6c6-4b74-b5e3-bd7636f5245a tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:16.640655 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1dc7afc5-a6c6-4b74-b5e3-bd7636f5245a tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:16.966611 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-1dc7afc5-a6c6-4b74-b5e3-bd7636f5245a tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:16.978015 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1dc7afc5-a6c6-4b74-b5e3-bd7636f5245a tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1562 microversion: 2.1 time: 0.353923 Feb 19 02:29:16.979503 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 270/525] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:16 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1562 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:17.101031 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7d10bde0-4a8e-4b9c-ad88-d2afb9aec431 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:17.102144 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7d10bde0-4a8e-4b9c-ad88-d2afb9aec431 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:17.110082 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7d10bde0-4a8e-4b9c-ad88-d2afb9aec431 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:17.110537 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7d10bde0-4a8e-4b9c-ad88-d2afb9aec431 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:17.111535 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7d10bde0-4a8e-4b9c-ad88-d2afb9aec431 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:17.112148 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7d10bde0-4a8e-4b9c-ad88-d2afb9aec431 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:17.254917 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-1f5d934f-b692-450d-8480-6ea25fa1f667 req-076fdd39-7210-44fe-920a-5df26ba58598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5265f377-f5b9-4f2c-a6e8-3bf64fb08733", "name": "network-vif-plugged", "status": "completed", "tag": "f7dc3053-2f41-4450-982f-60c5d1f56ee3"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:29:17.256834 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:29:17.256834 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:29:17.271717 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-1f5d934f-b692-450d-8480-6ea25fa1f667 req-076fdd39-7210-44fe-920a-5df26ba58598 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:17.277131 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-1f5d934f-b692-450d-8480-6ea25fa1f667 req-076fdd39-7210-44fe-920a-5df26ba58598 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:17.306149 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-1f5d934f-b692-450d-8480-6ea25fa1f667 req-076fdd39-7210-44fe-920a-5df26ba58598 service nova] Creating event network-vif-plugged:f7dc3053-2f41-4450-982f-60c5d1f56ee3 for instance 5265f377-f5b9-4f2c-a6e8-3bf64fb08733 on hv-cinder-77642 Feb 19 02:29:17.312508 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-1f5d934f-b692-450d-8480-6ea25fa1f667 req-076fdd39-7210-44fe-920a-5df26ba58598 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061718 Feb 19 02:29:17.313342 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 271/526] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:29:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:29:17.319369 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1a921c3a-34cf-4f9b-b87a-e8203e6a0f9d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:17.320553 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1a921c3a-34cf-4f9b-b87a-e8203e6a0f9d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:17.320712 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.objects.instance [None req-7d10bde0-4a8e-4b9c-ad88-d2afb9aec431 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lazy-loading 'services' on Instance uuid c0a55cfa-c2c0-48e5-b519-53c9b68c38cd {{(pid=98194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 02:29:17.329792 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1a921c3a-34cf-4f9b-b87a-e8203e6a0f9d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:17.330720 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1a921c3a-34cf-4f9b-b87a-e8203e6a0f9d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:17.331905 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1a921c3a-34cf-4f9b-b87a-e8203e6a0f9d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:17.332574 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1a921c3a-34cf-4f9b-b87a-e8203e6a0f9d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:17.393579 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-1a921c3a-34cf-4f9b-b87a-e8203e6a0f9d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] HTTP exception thrown: Instance cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4 could not be found. Feb 19 02:29:17.394163 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1a921c3a-34cf-4f9b-b87a-e8203e6a0f9d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Returning 404 to user: Instance cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4 could not be found. {{(pid=98193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:29:17.395382 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1a921c3a-34cf-4f9b-b87a-e8203e6a0f9d tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4" status: 404 len: 111 microversion: 2.1 time: 0.080658 Feb 19 02:29:17.396191 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 272/527] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:17 2021] GET /compute/v2.1/servers/cd5c38ce-4f39-42d7-a62c-22f4a12a7bc4 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 02:29:17.408893 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-9a474986-4479-4a6b-b016-dfc852f57e07 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:17.409578 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-9a474986-4479-4a6b-b016-dfc852f57e07 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:17.417850 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a474986-4479-4a6b-b016-dfc852f57e07 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:17.418385 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a474986-4479-4a6b-b016-dfc852f57e07 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:17.419404 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a474986-4479-4a6b-b016-dfc852f57e07 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:17.419906 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a474986-4479-4a6b-b016-dfc852f57e07 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:17.579672 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7d10bde0-4a8e-4b9c-ad88-d2afb9aec431 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd/os-volume_attachments/bca9cd62-15ee-4a4a-b207-14630f27db14" status: 202 len: 0 microversion: 2.1 time: 0.481019 Feb 19 02:29:17.594872 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 256/528] 10.222.0.44 () {58 vars in 1406 bytes} [Fri Feb 19 02:29:17 2021] DELETE /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd/os-volume_attachments/bca9cd62-15ee-4a4a-b207-14630f27db14 => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:29:17.788890 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9a474986-4479-4a6b-b016-dfc852f57e07 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:17.801082 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9a474986-4479-4a6b-b016-dfc852f57e07 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:17.807184 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9a474986-4479-4a6b-b016-dfc852f57e07 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:17.808487 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-9a474986-4479-4a6b-b016-dfc852f57e07 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1807 microversion: 2.20 time: 0.411470 Feb 19 02:29:17.809094 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 273/529] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:29:17 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1807 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:29:18.852347 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7e856836-e801-4527-b878-ec1f670237b5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:18.853592 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7e856836-e801-4527-b878-ec1f670237b5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:18.907365 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7e856836-e801-4527-b878-ec1f670237b5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:18.908177 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7e856836-e801-4527-b878-ec1f670237b5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:18.909546 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7e856836-e801-4527-b878-ec1f670237b5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:18.910335 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7e856836-e801-4527-b878-ec1f670237b5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:19.081310 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4faee221-5588-41e4-a079-589d77fc9469 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:19.082869 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-4faee221-5588-41e4-a079-589d77fc9469 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f4cde0d9-bb04-4e83-bc35-22f026ead5da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:19.097268 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4faee221-5588-41e4-a079-589d77fc9469 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:19.097769 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4faee221-5588-41e4-a079-589d77fc9469 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:19.098664 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4faee221-5588-41e4-a079-589d77fc9469 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:19.106492 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4faee221-5588-41e4-a079-589d77fc9469 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:19.239288 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-4faee221-5588-41e4-a079-589d77fc9469 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f4cde0d9-bb04-4e83-bc35-22f026ead5da] Going to try to terminate instance {{(pid=98193) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 02:29:19.468471 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-4faee221-5588-41e4-a079-589d77fc9469 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da" status: 204 len: 0 microversion: 2.1 time: 0.391323 Feb 19 02:29:19.469131 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 274/530] 10.222.0.44 () {58 vars in 1229 bytes} [Fri Feb 19 02:29:19 2021] DELETE /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 02:29:19.488613 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5f007d0a-8a4f-4a5c-bbe5-86b773fa7058 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:19.489556 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5f007d0a-8a4f-4a5c-bbe5-86b773fa7058 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f4cde0d9-bb04-4e83-bc35-22f026ead5da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:19.499689 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5f007d0a-8a4f-4a5c-bbe5-86b773fa7058 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:19.500195 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5f007d0a-8a4f-4a5c-bbe5-86b773fa7058 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:19.501202 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5f007d0a-8a4f-4a5c-bbe5-86b773fa7058 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:19.501735 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5f007d0a-8a4f-4a5c-bbe5-86b773fa7058 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:19.792413 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5f007d0a-8a4f-4a5c-bbe5-86b773fa7058 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:19.802010 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5f007d0a-8a4f-4a5c-bbe5-86b773fa7058 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da" status: 200 len: 1511 microversion: 2.1 time: 0.326437 Feb 19 02:29:19.802348 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 275/531] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:19 2021] GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da => generated 1511 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:19.802959 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7e856836-e801-4527-b878-ec1f670237b5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:19.816499 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7e856836-e801-4527-b878-ec1f670237b5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:19.818422 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7e856836-e801-4527-b878-ec1f670237b5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:19.819712 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7e856836-e801-4527-b878-ec1f670237b5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1807 microversion: 2.20 time: 0.992714 Feb 19 02:29:19.820319 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 257/532] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:29:18 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1807 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:29:20.820790 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-13a90bc4-d545-4066-8f2b-976fcd5c5888 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:20.821444 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-13a90bc4-d545-4066-8f2b-976fcd5c5888 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f4cde0d9-bb04-4e83-bc35-22f026ead5da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:20.843528 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1e9ce926-1cae-491d-b746-9bd5b08129ea tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:20.844513 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1e9ce926-1cae-491d-b746-9bd5b08129ea tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:20.845442 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-13a90bc4-d545-4066-8f2b-976fcd5c5888 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:20.846044 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-13a90bc4-d545-4066-8f2b-976fcd5c5888 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:20.847215 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-13a90bc4-d545-4066-8f2b-976fcd5c5888 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:20.847794 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-13a90bc4-d545-4066-8f2b-976fcd5c5888 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:20.867621 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1e9ce926-1cae-491d-b746-9bd5b08129ea tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:20.868243 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1e9ce926-1cae-491d-b746-9bd5b08129ea tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:20.869254 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1e9ce926-1cae-491d-b746-9bd5b08129ea tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:20.869836 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1e9ce926-1cae-491d-b746-9bd5b08129ea tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:21.417549 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-13a90bc4-d545-4066-8f2b-976fcd5c5888 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:21.428761 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-13a90bc4-d545-4066-8f2b-976fcd5c5888 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da" status: 200 len: 1511 microversion: 2.1 time: 0.611738 Feb 19 02:29:21.429982 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 276/533] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:20 2021] GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da => generated 1511 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:21.542758 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-1e9ce926-1cae-491d-b746-9bd5b08129ea tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:21.564269 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-1e9ce926-1cae-491d-b746-9bd5b08129ea tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:21.568198 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-1e9ce926-1cae-491d-b746-9bd5b08129ea tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:21.569870 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1e9ce926-1cae-491d-b746-9bd5b08129ea tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1807 microversion: 2.20 time: 0.733162 Feb 19 02:29:21.572044 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 258/534] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:29:20 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1807 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:29:22.057587 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-58d3eca5-d210-4107-936a-2a0b4e20be67 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:22.058508 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-58d3eca5-d210-4107-936a-2a0b4e20be67 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:22.067144 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-58d3eca5-d210-4107-936a-2a0b4e20be67 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:22.067966 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-58d3eca5-d210-4107-936a-2a0b4e20be67 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:22.069297 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-58d3eca5-d210-4107-936a-2a0b4e20be67 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:22.070508 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-58d3eca5-d210-4107-936a-2a0b4e20be67 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:22.145358 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-58d3eca5-d210-4107-936a-2a0b4e20be67 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Going to try to terminate instance {{(pid=98193) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 02:29:22.297324 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-58d3eca5-d210-4107-936a-2a0b4e20be67 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 204 len: 0 microversion: 2.1 time: 0.243147 Feb 19 02:29:22.299109 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 277/535] 10.222.0.44 () {58 vars in 1229 bytes} [Fri Feb 19 02:29:22 2021] DELETE /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 02:29:22.307318 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b4f4fa88-f62c-466a-8c4e-28281501a86e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:22.310138 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b4f4fa88-f62c-466a-8c4e-28281501a86e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:22.340991 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b4f4fa88-f62c-466a-8c4e-28281501a86e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:22.347627 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b4f4fa88-f62c-466a-8c4e-28281501a86e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:22.348847 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b4f4fa88-f62c-466a-8c4e-28281501a86e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:22.349499 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b4f4fa88-f62c-466a-8c4e-28281501a86e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:22.448548 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7ba29c07-a17e-4a34-b8dd-88424ee7c9a1 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:22.449638 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7ba29c07-a17e-4a34-b8dd-88424ee7c9a1 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f4cde0d9-bb04-4e83-bc35-22f026ead5da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:22.468621 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7ba29c07-a17e-4a34-b8dd-88424ee7c9a1 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:22.469303 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7ba29c07-a17e-4a34-b8dd-88424ee7c9a1 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:22.470531 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7ba29c07-a17e-4a34-b8dd-88424ee7c9a1 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:22.474828 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7ba29c07-a17e-4a34-b8dd-88424ee7c9a1 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:22.742635 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7ba29c07-a17e-4a34-b8dd-88424ee7c9a1 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:22.755239 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7ba29c07-a17e-4a34-b8dd-88424ee7c9a1 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da" status: 200 len: 1511 microversion: 2.1 time: 0.311621 Feb 19 02:29:22.756134 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 278/536] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:22 2021] GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da => generated 1511 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:22.762031 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5ea9d6d2-d154-4d1d-98aa-2fb9cad57bef tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:22.762777 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5ea9d6d2-d154-4d1d-98aa-2fb9cad57bef tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:22.772586 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5ea9d6d2-d154-4d1d-98aa-2fb9cad57bef tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:22.773931 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5ea9d6d2-d154-4d1d-98aa-2fb9cad57bef tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:22.775932 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5ea9d6d2-d154-4d1d-98aa-2fb9cad57bef tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:22.776602 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5ea9d6d2-d154-4d1d-98aa-2fb9cad57bef tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:23.013474 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5ea9d6d2-d154-4d1d-98aa-2fb9cad57bef tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:23.025271 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5ea9d6d2-d154-4d1d-98aa-2fb9cad57bef tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:23.026918 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5ea9d6d2-d154-4d1d-98aa-2fb9cad57bef tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:23.028622 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5ea9d6d2-d154-4d1d-98aa-2fb9cad57bef tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1794 microversion: 2.20 time: 0.271324 Feb 19 02:29:23.041025 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 279/537] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:29:22 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1794 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:29:23.041025 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-ccc27c22-7832-4b0f-8a64-5a531fa3397c req-1f6df999-e71a-4028-a8d4-102a85df8714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4cde0d9-bb04-4e83-bc35-22f026ead5da", "name": "network-vif-unplugged", "status": "completed", "tag": "bc9c2baf-39ce-43cd-95df-a8bcd7ed3497"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:29:23.041025 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:29:23.041025 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:29:23.050022 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-ccc27c22-7832-4b0f-8a64-5a531fa3397c req-1f6df999-e71a-4028-a8d4-102a85df8714 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:23.050822 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-ccc27c22-7832-4b0f-8a64-5a531fa3397c req-1f6df999-e71a-4028-a8d4-102a85df8714 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:23.075383 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-ccc27c22-7832-4b0f-8a64-5a531fa3397c req-1f6df999-e71a-4028-a8d4-102a85df8714 service nova] Creating event network-vif-unplugged:bc9c2baf-39ce-43cd-95df-a8bcd7ed3497 for instance f4cde0d9-bb04-4e83-bc35-22f026ead5da on hv-cinder-77642 Feb 19 02:29:23.082042 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-ccc27c22-7832-4b0f-8a64-5a531fa3397c req-1f6df999-e71a-4028-a8d4-102a85df8714 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051384 Feb 19 02:29:23.084006 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 280/538] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:29:23 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:29:23.183219 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b4f4fa88-f62c-466a-8c4e-28281501a86e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:23.194048 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b4f4fa88-f62c-466a-8c4e-28281501a86e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1507 microversion: 2.1 time: 0.890707 Feb 19 02:29:23.195104 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 259/539] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:22 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1507 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:23.728343 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-efea2ede-5685-4a29-9d28-f937063896c7 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1121840928", "imageRef": "37a0f9d8-d3f7-417e-bce6-371e41a47c88", "flavorRef": "452", "networks": [{"uuid": "d734f7f3-2e72-4bf5-8705-7f9359473827"}]}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:29:23.773527 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5358e3d0-ff67-4e69-b147-abe93e562e92 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:23.774222 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5358e3d0-ff67-4e69-b147-abe93e562e92 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f4cde0d9-bb04-4e83-bc35-22f026ead5da] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:23.795129 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5358e3d0-ff67-4e69-b147-abe93e562e92 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:23.795899 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5358e3d0-ff67-4e69-b147-abe93e562e92 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:23.796920 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5358e3d0-ff67-4e69-b147-abe93e562e92 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:23.797569 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5358e3d0-ff67-4e69-b147-abe93e562e92 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:23.902178 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-efea2ede-5685-4a29-9d28-f937063896c7 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] validate_networks() for [('d734f7f3-2e72-4bf5-8705-7f9359473827', None, None, None)] {{(pid=98193) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 02:29:24.588139 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5358e3d0-ff67-4e69-b147-abe93e562e92 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:24.597134 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5358e3d0-ff67-4e69-b147-abe93e562e92 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da" status: 200 len: 1511 microversion: 2.1 time: 0.827810 Feb 19 02:29:24.608026 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 260/540] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:23 2021] GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da => generated 1511 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:24.613321 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5161547e-c079-4465-a5db-f4bfe768ed33 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:24.614261 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5161547e-c079-4465-a5db-f4bfe768ed33 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:24.624806 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5161547e-c079-4465-a5db-f4bfe768ed33 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:24.625797 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5161547e-c079-4465-a5db-f4bfe768ed33 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:24.627184 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5161547e-c079-4465-a5db-f4bfe768ed33 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:24.627869 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5161547e-c079-4465-a5db-f4bfe768ed33 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:25.190377 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-efea2ede-5685-4a29-9d28-f937063896c7 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Flavor limits 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 02:29:25.191132 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-efea2ede-5685-4a29-9d28-f937063896c7 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Image limits 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 02:29:25.193036 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-efea2ede-5685-4a29-9d28-f937063896c7 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Flavor pref 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 02:29:25.193665 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-efea2ede-5685-4a29-9d28-f937063896c7 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Image pref 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 02:29:25.194276 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-efea2ede-5685-4a29-9d28-f937063896c7 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 02:29:25.208558 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-efea2ede-5685-4a29-9d28-f937063896c7 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:25.209798 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-efea2ede-5685-4a29-9d28-f937063896c7 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:25.211028 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-efea2ede-5685-4a29-9d28-f937063896c7 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:25.211828 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-efea2ede-5685-4a29-9d28-f937063896c7 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:25.239457 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-efea2ede-5685-4a29-9d28-f937063896c7 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Getting quotas for project 34bd5f2d3f10452aa7848bc1d229dfdd. Resources: {'ram', 'instances', 'cores'} {{(pid=98193) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:29:25.244921 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-efea2ede-5685-4a29-9d28-f937063896c7 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Getting quotas for user 5da5618e5a5640c28593881e6d144469 and project 34bd5f2d3f10452aa7848bc1d229dfdd. Resources: {'ram', 'instances', 'cores'} {{(pid=98193) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:29:25.257006 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-efea2ede-5685-4a29-9d28-f937063896c7 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Going to run 1 instances... {{(pid=98193) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 02:29:25.259814 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-efea2ede-5685-4a29-9d28-f937063896c7 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2e279104-c2ca-4bf4-872c-2804655e5a74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37a0f9d8-d3f7-417e-bce6-371e41a47c88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 02:29:25.315656 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-efea2ede-5685-4a29-9d28-f937063896c7 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.605922 Feb 19 02:29:25.316937 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 281/541] 10.222.0.44 () {60 vars in 1137 bytes} [Fri Feb 19 02:29:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 1608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 02:29:25.322502 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-a21af0b7-8865-4b96-8cd9-1da0977bbfbd req-0a8a275e-9f5e-4401-9271-5f87d28ae8e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4cde0d9-bb04-4e83-bc35-22f026ead5da", "name": "network-vif-deleted", "tag": "bc9c2baf-39ce-43cd-95df-a8bcd7ed3497"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:29:25.324423 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:29:25.324423 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:29:25.336161 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-a21af0b7-8865-4b96-8cd9-1da0977bbfbd req-0a8a275e-9f5e-4401-9271-5f87d28ae8e8 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:25.336899 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-a21af0b7-8865-4b96-8cd9-1da0977bbfbd req-0a8a275e-9f5e-4401-9271-5f87d28ae8e8 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:25.357250 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-a21af0b7-8865-4b96-8cd9-1da0977bbfbd req-0a8a275e-9f5e-4401-9271-5f87d28ae8e8 service nova] Creating event network-vif-deleted:bc9c2baf-39ce-43cd-95df-a8bcd7ed3497 for instance f4cde0d9-bb04-4e83-bc35-22f026ead5da on hv-cinder-77642 Feb 19 02:29:25.362804 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-a21af0b7-8865-4b96-8cd9-1da0977bbfbd req-0a8a275e-9f5e-4401-9271-5f87d28ae8e8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044119 Feb 19 02:29:25.363651 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 282/542] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:29:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:29:25.369660 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8afe3d37-84d7-4d1b-8a35-3a863cbee875 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:25.370795 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8afe3d37-84d7-4d1b-8a35-3a863cbee875 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2e279104-c2ca-4bf4-872c-2804655e5a74] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:25.416616 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5161547e-c079-4465-a5db-f4bfe768ed33 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:25.432276 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5161547e-c079-4465-a5db-f4bfe768ed33 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1507 microversion: 2.1 time: 0.822750 Feb 19 02:29:25.432929 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 261/543] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:24 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1507 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:25.560689 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8afe3d37-84d7-4d1b-8a35-3a863cbee875 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da5618e5a5640c28593881e6d144469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd5f2d3f10452aa7848bc1d229dfdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:25.572036 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8afe3d37-84d7-4d1b-8a35-3a863cbee875 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "GET /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74" status: 200 len: 1219 microversion: 2.1 time: 0.206853 Feb 19 02:29:25.579269 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 283/544] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:25 2021] GET /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74 => generated 1219 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:25.615059 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-983c61dd-b95c-4595-9bb0-10c69946c1ef tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:25.615728 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-983c61dd-b95c-4595-9bb0-10c69946c1ef tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f4cde0d9-bb04-4e83-bc35-22f026ead5da] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:25.625098 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-983c61dd-b95c-4595-9bb0-10c69946c1ef tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:25.627290 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-983c61dd-b95c-4595-9bb0-10c69946c1ef tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:25.629223 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-983c61dd-b95c-4595-9bb0-10c69946c1ef tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:25.630833 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-983c61dd-b95c-4595-9bb0-10c69946c1ef tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:25.740250 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-983c61dd-b95c-4595-9bb0-10c69946c1ef tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:25.740760 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-983c61dd-b95c-4595-9bb0-10c69946c1ef tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:25.741473 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.objects.instance [None req-983c61dd-b95c-4595-9bb0-10c69946c1ef tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lazy-loading 'fault' on Instance uuid f4cde0d9-bb04-4e83-bc35-22f026ead5da {{(pid=98194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 02:29:26.259857 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-983c61dd-b95c-4595-9bb0-10c69946c1ef tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50e5a3cbcd6e4b73badbf6ca8db58941', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf138e653b034c909eb38d6f109c2c4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:26.272246 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-983c61dd-b95c-4595-9bb0-10c69946c1ef tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da" status: 200 len: 1308 microversion: 2.1 time: 0.660110 Feb 19 02:29:26.276073 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 262/545] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:25 2021] GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da => generated 1308 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:26.453246 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5efcf49d-4dab-4236-9fd7-29cf0d96bb92 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:26.454780 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5efcf49d-4dab-4236-9fd7-29cf0d96bb92 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:26.474067 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5efcf49d-4dab-4236-9fd7-29cf0d96bb92 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:26.475450 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5efcf49d-4dab-4236-9fd7-29cf0d96bb92 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:26.476501 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5efcf49d-4dab-4236-9fd7-29cf0d96bb92 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:26.477147 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5efcf49d-4dab-4236-9fd7-29cf0d96bb92 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:26.600107 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7291f530-0083-4d31-a25e-29834d93f4dd tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:26.601961 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7291f530-0083-4d31-a25e-29834d93f4dd tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2e279104-c2ca-4bf4-872c-2804655e5a74] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:26.612242 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7291f530-0083-4d31-a25e-29834d93f4dd tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:26.613162 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7291f530-0083-4d31-a25e-29834d93f4dd tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:26.614201 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7291f530-0083-4d31-a25e-29834d93f4dd tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:26.614948 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7291f530-0083-4d31-a25e-29834d93f4dd tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:26.657072 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5efcf49d-4dab-4236-9fd7-29cf0d96bb92 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:26.674913 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5efcf49d-4dab-4236-9fd7-29cf0d96bb92 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 200 len: 1465 microversion: 2.1 time: 0.223889 Feb 19 02:29:26.675607 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 284/546] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:26 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 1465 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:26.785551 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7291f530-0083-4d31-a25e-29834d93f4dd tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da5618e5a5640c28593881e6d144469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd5f2d3f10452aa7848bc1d229dfdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:26.796549 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7291f530-0083-4d31-a25e-29834d93f4dd tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "GET /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74" status: 200 len: 1271 microversion: 2.1 time: 0.203014 Feb 19 02:29:26.797330 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 263/547] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:26 2021] GET /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74 => generated 1271 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:27.293240 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e633126b-afb9-4fd1-a0de-2f06b2d1f4f9 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:27.293901 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e633126b-afb9-4fd1-a0de-2f06b2d1f4f9 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] [instance: f4cde0d9-bb04-4e83-bc35-22f026ead5da] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:27.301939 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e633126b-afb9-4fd1-a0de-2f06b2d1f4f9 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:27.303352 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e633126b-afb9-4fd1-a0de-2f06b2d1f4f9 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:27.304225 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e633126b-afb9-4fd1-a0de-2f06b2d1f4f9 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:27.304715 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e633126b-afb9-4fd1-a0de-2f06b2d1f4f9 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:27.368133 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-e633126b-afb9-4fd1-a0de-2f06b2d1f4f9 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] HTTP exception thrown: Instance f4cde0d9-bb04-4e83-bc35-22f026ead5da could not be found. Feb 19 02:29:27.369218 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e633126b-afb9-4fd1-a0de-2f06b2d1f4f9 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] Returning 404 to user: Instance f4cde0d9-bb04-4e83-bc35-22f026ead5da could not be found. {{(pid=98193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:29:27.369706 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e633126b-afb9-4fd1-a0de-2f06b2d1f4f9 tempest-AttachVolumeNegativeTest-1502829366 tempest-AttachVolumeNegativeTest-1502829366-project] 10.222.0.44 "GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da" status: 404 len: 111 microversion: 2.1 time: 0.080695 Feb 19 02:29:27.370340 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 285/548] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:27 2021] GET /compute/v2.1/servers/f4cde0d9-bb04-4e83-bc35-22f026ead5da => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 02:29:27.388618 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-0cf5b1cd-ef9b-4211-9025-b91dccb037ec req-56fc9ae8-9e8a-4b12-83e6-37bcc448644c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a95f9f7-96ac-4fc6-8ef3-95fb723b525a", "name": "network-vif-deleted", "tag": "023b83ee-b321-4330-8efb-ac121d463f35"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:29:27.390660 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:29:27.390660 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:29:27.400287 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-0cf5b1cd-ef9b-4211-9025-b91dccb037ec req-56fc9ae8-9e8a-4b12-83e6-37bcc448644c service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:27.400794 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-0cf5b1cd-ef9b-4211-9025-b91dccb037ec req-56fc9ae8-9e8a-4b12-83e6-37bcc448644c service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:27.423853 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-0cf5b1cd-ef9b-4211-9025-b91dccb037ec req-56fc9ae8-9e8a-4b12-83e6-37bcc448644c service nova] Creating event network-vif-deleted:023b83ee-b321-4330-8efb-ac121d463f35 for instance 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a on hv-cinder-77642 Feb 19 02:29:27.441016 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-0cf5b1cd-ef9b-4211-9025-b91dccb037ec req-56fc9ae8-9e8a-4b12-83e6-37bcc448644c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056225 Feb 19 02:29:27.442236 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 264/549] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:29:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:29:27.694520 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ab6dcf7b-042d-4972-90a6-ba01d387c797 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:27.696160 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ab6dcf7b-042d-4972-90a6-ba01d387c797 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:27.704699 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ab6dcf7b-042d-4972-90a6-ba01d387c797 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:27.705452 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ab6dcf7b-042d-4972-90a6-ba01d387c797 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:27.712031 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ab6dcf7b-042d-4972-90a6-ba01d387c797 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:27.713067 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ab6dcf7b-042d-4972-90a6-ba01d387c797 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:27.783613 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-ab6dcf7b-042d-4972-90a6-ba01d387c797 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] HTTP exception thrown: Instance 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a could not be found. Feb 19 02:29:27.784294 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ab6dcf7b-042d-4972-90a6-ba01d387c797 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Returning 404 to user: Instance 0a95f9f7-96ac-4fc6-8ef3-95fb723b525a could not be found. {{(pid=98193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:29:27.785215 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ab6dcf7b-042d-4972-90a6-ba01d387c797 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a" status: 404 len: 111 microversion: 2.1 time: 0.095334 Feb 19 02:29:27.786136 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 286/550] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:27 2021] GET /compute/v2.1/servers/0a95f9f7-96ac-4fc6-8ef3-95fb723b525a => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 02:29:27.795831 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8fad2426-f255-4764-bcdf-d5f81b7952e1 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:27.796893 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8fad2426-f255-4764-bcdf-d5f81b7952e1 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:27.806128 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8fad2426-f255-4764-bcdf-d5f81b7952e1 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:27.807091 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8fad2426-f255-4764-bcdf-d5f81b7952e1 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:27.808288 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8fad2426-f255-4764-bcdf-d5f81b7952e1 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:27.809288 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8fad2426-f255-4764-bcdf-d5f81b7952e1 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:27.825115 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5f20feea-726e-4b6a-9cf0-0d8b6ccc52c9 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:27.826058 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5f20feea-726e-4b6a-9cf0-0d8b6ccc52c9 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2e279104-c2ca-4bf4-872c-2804655e5a74] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:27.836456 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5f20feea-726e-4b6a-9cf0-0d8b6ccc52c9 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:27.836963 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5f20feea-726e-4b6a-9cf0-0d8b6ccc52c9 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:27.837814 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5f20feea-726e-4b6a-9cf0-0d8b6ccc52c9 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:27.838304 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5f20feea-726e-4b6a-9cf0-0d8b6ccc52c9 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:27.891369 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8fad2426-f255-4764-bcdf-d5f81b7952e1 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Going to try to terminate instance {{(pid=98194) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 02:29:28.105749 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5f20feea-726e-4b6a-9cf0-0d8b6ccc52c9 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da5618e5a5640c28593881e6d144469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd5f2d3f10452aa7848bc1d229dfdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:28.115457 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8fad2426-f255-4764-bcdf-d5f81b7952e1 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 204 len: 0 microversion: 2.1 time: 0.322559 Feb 19 02:29:28.119950 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 265/551] 10.222.0.44 () {58 vars in 1229 bytes} [Fri Feb 19 02:29:27 2021] DELETE /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 02:29:28.122930 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5f20feea-726e-4b6a-9cf0-0d8b6ccc52c9 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "GET /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74" status: 200 len: 1277 microversion: 2.1 time: 0.309524 Feb 19 02:29:28.123665 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 287/552] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:27 2021] GET /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74 => generated 1277 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:28.138427 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-440421bb-8519-4fa0-af3b-4eaa969067a5 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:28.139211 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-440421bb-8519-4fa0-af3b-4eaa969067a5 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:28.149190 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-440421bb-8519-4fa0-af3b-4eaa969067a5 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:28.149707 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-440421bb-8519-4fa0-af3b-4eaa969067a5 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:28.151414 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-440421bb-8519-4fa0-af3b-4eaa969067a5 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:28.151914 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-440421bb-8519-4fa0-af3b-4eaa969067a5 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:28.804460 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-440421bb-8519-4fa0-af3b-4eaa969067a5 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:28.816380 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-440421bb-8519-4fa0-af3b-4eaa969067a5 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1522 microversion: 2.1 time: 0.693970 Feb 19 02:29:28.821043 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 266/553] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:28 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1522 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:29.141588 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a9d3482a-d89c-4b03-8f7a-2b684b1d4d65 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:29.142167 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a9d3482a-d89c-4b03-8f7a-2b684b1d4d65 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2e279104-c2ca-4bf4-872c-2804655e5a74] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:29.150298 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a9d3482a-d89c-4b03-8f7a-2b684b1d4d65 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:29.151075 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a9d3482a-d89c-4b03-8f7a-2b684b1d4d65 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:29.152092 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a9d3482a-d89c-4b03-8f7a-2b684b1d4d65 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:29.152728 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a9d3482a-d89c-4b03-8f7a-2b684b1d4d65 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:29.837021 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e1996fe6-b1cd-43a4-a064-7b25c514522f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:29.838284 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e1996fe6-b1cd-43a4-a064-7b25c514522f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:29.847153 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e1996fe6-b1cd-43a4-a064-7b25c514522f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:29.847883 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e1996fe6-b1cd-43a4-a064-7b25c514522f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:29.848934 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e1996fe6-b1cd-43a4-a064-7b25c514522f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:29.849707 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e1996fe6-b1cd-43a4-a064-7b25c514522f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:30.002424 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a9d3482a-d89c-4b03-8f7a-2b684b1d4d65 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da5618e5a5640c28593881e6d144469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd5f2d3f10452aa7848bc1d229dfdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:30.013191 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a9d3482a-d89c-4b03-8f7a-2b684b1d4d65 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "GET /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74" status: 200 len: 1319 microversion: 2.1 time: 0.875381 Feb 19 02:29:30.014661 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 288/554] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:29 2021] GET /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74 => generated 1319 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:30.719320 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e1996fe6-b1cd-43a4-a064-7b25c514522f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:30.735550 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e1996fe6-b1cd-43a4-a064-7b25c514522f tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1522 microversion: 2.1 time: 0.903096 Feb 19 02:29:30.736384 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 267/555] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:29 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1522 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:31.031714 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ba9f2334-ab80-4db4-9c78-10f076557f86 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:31.032383 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ba9f2334-ab80-4db4-9c78-10f076557f86 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2e279104-c2ca-4bf4-872c-2804655e5a74] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:31.042370 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ba9f2334-ab80-4db4-9c78-10f076557f86 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:31.042885 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ba9f2334-ab80-4db4-9c78-10f076557f86 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:31.043755 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ba9f2334-ab80-4db4-9c78-10f076557f86 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:31.044235 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ba9f2334-ab80-4db4-9c78-10f076557f86 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:31.376366 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ba9f2334-ab80-4db4-9c78-10f076557f86 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da5618e5a5640c28593881e6d144469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd5f2d3f10452aa7848bc1d229dfdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:31.389994 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ba9f2334-ab80-4db4-9c78-10f076557f86 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "GET /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74" status: 200 len: 1319 microversion: 2.1 time: 0.362131 Feb 19 02:29:31.390687 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 289/556] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:31 2021] GET /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74 => generated 1319 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:31.581796 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-77a3dd90-72a7-4656-99f2-611a67d7ef5c req-114b794b-18b1-45c8-bced-795762a9a1fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e279104-c2ca-4bf4-872c-2804655e5a74", "tag": "3c8c8966-a8f7-40ab-8c5e-69bd76842ed3"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:29:31.589568 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:29:31.589568 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:29:31.606762 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-77a3dd90-72a7-4656-99f2-611a67d7ef5c req-114b794b-18b1-45c8-bced-795762a9a1fa service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:31.607956 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-77a3dd90-72a7-4656-99f2-611a67d7ef5c req-114b794b-18b1-45c8-bced-795762a9a1fa service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:31.633357 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-77a3dd90-72a7-4656-99f2-611a67d7ef5c req-114b794b-18b1-45c8-bced-795762a9a1fa service nova] Creating event network-changed:3c8c8966-a8f7-40ab-8c5e-69bd76842ed3 for instance 2e279104-c2ca-4bf4-872c-2804655e5a74 on hv-cinder-77642 Feb 19 02:29:31.640819 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-77a3dd90-72a7-4656-99f2-611a67d7ef5c req-114b794b-18b1-45c8-bced-795762a9a1fa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070195 Feb 19 02:29:31.641650 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 268/557] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:29:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:29:31.755423 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c215f908-be18-45cc-aaa4-aeb6d5b01d87 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:31.756608 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c215f908-be18-45cc-aaa4-aeb6d5b01d87 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:31.765645 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c215f908-be18-45cc-aaa4-aeb6d5b01d87 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:31.766468 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c215f908-be18-45cc-aaa4-aeb6d5b01d87 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:31.767539 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c215f908-be18-45cc-aaa4-aeb6d5b01d87 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:31.768263 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c215f908-be18-45cc-aaa4-aeb6d5b01d87 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:32.068457 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c215f908-be18-45cc-aaa4-aeb6d5b01d87 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:32.102010 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c215f908-be18-45cc-aaa4-aeb6d5b01d87 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1522 microversion: 2.1 time: 0.350945 Feb 19 02:29:32.102714 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 290/558] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:31 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:32.408930 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-3da4ca01-d0a3-4cf1-a3cb-cb5b6813e025 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:32.409697 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-3da4ca01-d0a3-4cf1-a3cb-cb5b6813e025 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2e279104-c2ca-4bf4-872c-2804655e5a74] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:32.428242 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3da4ca01-d0a3-4cf1-a3cb-cb5b6813e025 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:32.430883 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3da4ca01-d0a3-4cf1-a3cb-cb5b6813e025 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:32.431765 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3da4ca01-d0a3-4cf1-a3cb-cb5b6813e025 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:32.434699 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3da4ca01-d0a3-4cf1-a3cb-cb5b6813e025 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:33.120974 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-78e962a2-9332-4398-b996-449316ceb2c3 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:33.122490 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-78e962a2-9332-4398-b996-449316ceb2c3 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:33.132743 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-78e962a2-9332-4398-b996-449316ceb2c3 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:33.134171 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-78e962a2-9332-4398-b996-449316ceb2c3 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:33.135718 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-78e962a2-9332-4398-b996-449316ceb2c3 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:33.136439 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-78e962a2-9332-4398-b996-449316ceb2c3 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:33.426483 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-78e962a2-9332-4398-b996-449316ceb2c3 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:33.440723 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-78e962a2-9332-4398-b996-449316ceb2c3 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1522 microversion: 2.1 time: 0.324037 Feb 19 02:29:33.442426 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 291/559] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:33 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:29:33.534834 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-3da4ca01-d0a3-4cf1-a3cb-cb5b6813e025 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da5618e5a5640c28593881e6d144469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd5f2d3f10452aa7848bc1d229dfdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:33.544757 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-3da4ca01-d0a3-4cf1-a3cb-cb5b6813e025 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "GET /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74" status: 200 len: 1319 microversion: 2.1 time: 1.140907 Feb 19 02:29:33.548449 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 269/560] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:32 2021] GET /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74 => generated 1319 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:34.461690 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e0c715bf-de74-4a89-91b3-3e985945cb98 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:34.462935 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e0c715bf-de74-4a89-91b3-3e985945cb98 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:34.471780 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e0c715bf-de74-4a89-91b3-3e985945cb98 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:34.472520 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e0c715bf-de74-4a89-91b3-3e985945cb98 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:34.473608 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e0c715bf-de74-4a89-91b3-3e985945cb98 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:34.474197 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e0c715bf-de74-4a89-91b3-3e985945cb98 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:34.565330 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d0c15a08-cbe5-4740-84e0-dcd681a289ef tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:34.565893 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d0c15a08-cbe5-4740-84e0-dcd681a289ef tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2e279104-c2ca-4bf4-872c-2804655e5a74] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:34.574779 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d0c15a08-cbe5-4740-84e0-dcd681a289ef tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:34.575847 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d0c15a08-cbe5-4740-84e0-dcd681a289ef tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:34.576910 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d0c15a08-cbe5-4740-84e0-dcd681a289ef tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:34.577601 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d0c15a08-cbe5-4740-84e0-dcd681a289ef tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:34.728405 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e0c715bf-de74-4a89-91b3-3e985945cb98 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:34.738708 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e0c715bf-de74-4a89-91b3-3e985945cb98 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1522 microversion: 2.1 time: 0.281327 Feb 19 02:29:34.739347 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 292/561] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:34 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:35.176451 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-fd87d53c-a805-43c6-824c-186fde810c6b req-59a77ecd-31d9-4372-aec4-ffb2394109b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e279104-c2ca-4bf4-872c-2804655e5a74", "name": "network-vif-plugged", "status": "completed", "tag": "3c8c8966-a8f7-40ab-8c5e-69bd76842ed3"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:29:35.178134 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:29:35.178134 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:29:35.193444 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-fd87d53c-a805-43c6-824c-186fde810c6b req-59a77ecd-31d9-4372-aec4-ffb2394109b0 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:35.194382 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-fd87d53c-a805-43c6-824c-186fde810c6b req-59a77ecd-31d9-4372-aec4-ffb2394109b0 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:35.222932 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-fd87d53c-a805-43c6-824c-186fde810c6b req-59a77ecd-31d9-4372-aec4-ffb2394109b0 service nova] Creating event network-vif-plugged:3c8c8966-a8f7-40ab-8c5e-69bd76842ed3 for instance 2e279104-c2ca-4bf4-872c-2804655e5a74 on hv-cinder-77642 Feb 19 02:29:35.229445 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-fd87d53c-a805-43c6-824c-186fde810c6b req-59a77ecd-31d9-4372-aec4-ffb2394109b0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056869 Feb 19 02:29:35.230136 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 293/562] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:29:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:29:35.758922 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-bf3c3880-8e5c-47f6-88c9-3c2ca59b96e1 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:35.760182 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-bf3c3880-8e5c-47f6-88c9-3c2ca59b96e1 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:35.769385 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bf3c3880-8e5c-47f6-88c9-3c2ca59b96e1 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:35.770187 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bf3c3880-8e5c-47f6-88c9-3c2ca59b96e1 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:35.771280 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bf3c3880-8e5c-47f6-88c9-3c2ca59b96e1 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:35.771970 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bf3c3880-8e5c-47f6-88c9-3c2ca59b96e1 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:35.857768 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-d0c15a08-cbe5-4740-84e0-dcd681a289ef tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da5618e5a5640c28593881e6d144469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd5f2d3f10452aa7848bc1d229dfdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:35.868551 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d0c15a08-cbe5-4740-84e0-dcd681a289ef tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "GET /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74" status: 200 len: 1319 microversion: 2.1 time: 1.307228 Feb 19 02:29:35.869491 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 270/563] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:34 2021] GET /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74 => generated 1319 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:36.048360 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-bf3c3880-8e5c-47f6-88c9-3c2ca59b96e1 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:36.057501 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-bf3c3880-8e5c-47f6-88c9-3c2ca59b96e1 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1522 microversion: 2.1 time: 0.303871 Feb 19 02:29:36.058236 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 294/564] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:35 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:36.887383 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-fab7cf3b-48e7-4598-9248-5a19be0ee4de tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:36.888282 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-fab7cf3b-48e7-4598-9248-5a19be0ee4de tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2e279104-c2ca-4bf4-872c-2804655e5a74] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:36.899314 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fab7cf3b-48e7-4598-9248-5a19be0ee4de tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:36.900046 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fab7cf3b-48e7-4598-9248-5a19be0ee4de tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:36.901063 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fab7cf3b-48e7-4598-9248-5a19be0ee4de tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:36.901531 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fab7cf3b-48e7-4598-9248-5a19be0ee4de tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:37.076442 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-cde510c8-1b54-4ab5-98a5-02161e85d83d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:37.077227 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-cde510c8-1b54-4ab5-98a5-02161e85d83d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:37.085528 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cde510c8-1b54-4ab5-98a5-02161e85d83d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:37.086120 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cde510c8-1b54-4ab5-98a5-02161e85d83d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:37.087072 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cde510c8-1b54-4ab5-98a5-02161e85d83d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:37.087574 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cde510c8-1b54-4ab5-98a5-02161e85d83d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:37.305141 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-cde510c8-1b54-4ab5-98a5-02161e85d83d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:37.314234 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-cde510c8-1b54-4ab5-98a5-02161e85d83d tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1522 microversion: 2.1 time: 0.242288 Feb 19 02:29:37.314892 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 295/565] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:37 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:29:37.319555 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-c7878ecf-695e-4566-b829-ac3fc1c4fa49 req-db1d9a78-7a91-4318-b923-76429a2e6d9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0a55cfa-c2c0-48e5-b519-53c9b68c38cd", "name": "network-vif-unplugged", "status": "completed", "tag": "0ea13f49-61f4-4ec3-9378-7226894dc825"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:29:37.321226 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:29:37.321226 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:29:37.330010 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-c7878ecf-695e-4566-b829-ac3fc1c4fa49 req-db1d9a78-7a91-4318-b923-76429a2e6d9a service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:37.330549 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-c7878ecf-695e-4566-b829-ac3fc1c4fa49 req-db1d9a78-7a91-4318-b923-76429a2e6d9a service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:37.348499 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-c7878ecf-695e-4566-b829-ac3fc1c4fa49 req-db1d9a78-7a91-4318-b923-76429a2e6d9a service nova] Creating event network-vif-unplugged:0ea13f49-61f4-4ec3-9378-7226894dc825 for instance c0a55cfa-c2c0-48e5-b519-53c9b68c38cd on hv-cinder-77642 Feb 19 02:29:37.354121 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-c7878ecf-695e-4566-b829-ac3fc1c4fa49 req-db1d9a78-7a91-4318-b923-76429a2e6d9a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038027 Feb 19 02:29:37.354809 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 296/566] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:29:37 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:29:37.915950 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-fab7cf3b-48e7-4598-9248-5a19be0ee4de tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da5618e5a5640c28593881e6d144469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd5f2d3f10452aa7848bc1d229dfdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:37.926152 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-fab7cf3b-48e7-4598-9248-5a19be0ee4de tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "GET /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74" status: 200 len: 1319 microversion: 2.1 time: 1.042672 Feb 19 02:29:37.929596 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 271/567] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:36 2021] GET /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74 => generated 1319 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:38.333425 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-341a4797-9a1e-4ba6-bc8b-851a16d5389e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:38.334195 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-341a4797-9a1e-4ba6-bc8b-851a16d5389e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:38.342422 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-341a4797-9a1e-4ba6-bc8b-851a16d5389e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:38.342907 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-341a4797-9a1e-4ba6-bc8b-851a16d5389e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:38.343743 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-341a4797-9a1e-4ba6-bc8b-851a16d5389e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:38.344236 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-341a4797-9a1e-4ba6-bc8b-851a16d5389e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:38.379204 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-a161720b-0d5f-4470-923f-51baeb4318f4 req-668cf889-7e99-483b-87c4-ea9d430767cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0a55cfa-c2c0-48e5-b519-53c9b68c38cd", "name": "network-vif-deleted", "tag": "0ea13f49-61f4-4ec3-9378-7226894dc825"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:29:38.380979 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:29:38.380979 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:29:38.390822 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-a161720b-0d5f-4470-923f-51baeb4318f4 req-668cf889-7e99-483b-87c4-ea9d430767cd service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:38.391589 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-a161720b-0d5f-4470-923f-51baeb4318f4 req-668cf889-7e99-483b-87c4-ea9d430767cd service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:38.411637 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-a161720b-0d5f-4470-923f-51baeb4318f4 req-668cf889-7e99-483b-87c4-ea9d430767cd service nova] Creating event network-vif-deleted:0ea13f49-61f4-4ec3-9378-7226894dc825 for instance c0a55cfa-c2c0-48e5-b519-53c9b68c38cd on hv-cinder-77642 Feb 19 02:29:38.417689 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-a161720b-0d5f-4470-923f-51baeb4318f4 req-668cf889-7e99-483b-87c4-ea9d430767cd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042734 Feb 19 02:29:38.418419 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 272/568] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:29:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:29:38.476125 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-341a4797-9a1e-4ba6-bc8b-851a16d5389e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:38.485144 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-341a4797-9a1e-4ba6-bc8b-851a16d5389e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1480 microversion: 2.1 time: 0.156297 Feb 19 02:29:38.485766 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 297/569] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:38 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1480 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:38.949962 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b2d0a0a0-f76f-42d1-8893-bf1e375121b0 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:38.951778 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b2d0a0a0-f76f-42d1-8893-bf1e375121b0 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2e279104-c2ca-4bf4-872c-2804655e5a74] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:38.962121 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b2d0a0a0-f76f-42d1-8893-bf1e375121b0 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:38.962977 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b2d0a0a0-f76f-42d1-8893-bf1e375121b0 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:38.965602 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b2d0a0a0-f76f-42d1-8893-bf1e375121b0 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:38.966180 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b2d0a0a0-f76f-42d1-8893-bf1e375121b0 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:39.393901 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b2d0a0a0-f76f-42d1-8893-bf1e375121b0 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da5618e5a5640c28593881e6d144469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd5f2d3f10452aa7848bc1d229dfdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:39.403609 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b2d0a0a0-f76f-42d1-8893-bf1e375121b0 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "GET /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74" status: 200 len: 1319 microversion: 2.1 time: 0.459249 Feb 19 02:29:39.404296 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 273/570] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:38 2021] GET /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74 => generated 1319 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:39.504130 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-24a23c10-b890-428f-84b7-63c7dd153f22 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:39.505067 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-24a23c10-b890-428f-84b7-63c7dd153f22 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:39.514138 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-24a23c10-b890-428f-84b7-63c7dd153f22 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:39.514979 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-24a23c10-b890-428f-84b7-63c7dd153f22 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:39.516225 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-24a23c10-b890-428f-84b7-63c7dd153f22 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:39.517029 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-24a23c10-b890-428f-84b7-63c7dd153f22 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:39.648228 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-24a23c10-b890-428f-84b7-63c7dd153f22 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfa75e601e4640da9444d14362d021a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdc6eeb362640cd96dab7841d609efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:39.666339 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-24a23c10-b890-428f-84b7-63c7dd153f22 tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 200 len: 1307 microversion: 2.1 time: 0.165811 Feb 19 02:29:39.667270 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 298/571] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:39 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 1307 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:40.421699 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4c8c8bf5-5641-4aa6-9b18-d864aa5814fa tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:40.422724 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-4c8c8bf5-5641-4aa6-9b18-d864aa5814fa tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2e279104-c2ca-4bf4-872c-2804655e5a74] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:40.432823 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4c8c8bf5-5641-4aa6-9b18-d864aa5814fa tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:40.433697 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4c8c8bf5-5641-4aa6-9b18-d864aa5814fa tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:40.434859 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4c8c8bf5-5641-4aa6-9b18-d864aa5814fa tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:40.435427 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4c8c8bf5-5641-4aa6-9b18-d864aa5814fa tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:40.684749 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-77fc688a-f36a-434d-be47-dde0862c4b3e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:40.685516 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-77fc688a-f36a-434d-be47-dde0862c4b3e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] [instance: c0a55cfa-c2c0-48e5-b519-53c9b68c38cd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:40.693606 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-77fc688a-f36a-434d-be47-dde0862c4b3e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:40.695662 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-77fc688a-f36a-434d-be47-dde0862c4b3e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:40.696597 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-77fc688a-f36a-434d-be47-dde0862c4b3e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:40.697157 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-77fc688a-f36a-434d-be47-dde0862c4b3e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:40.763665 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-77fc688a-f36a-434d-be47-dde0862c4b3e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] HTTP exception thrown: Instance c0a55cfa-c2c0-48e5-b519-53c9b68c38cd could not be found. Feb 19 02:29:40.764311 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-77fc688a-f36a-434d-be47-dde0862c4b3e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] Returning 404 to user: Instance c0a55cfa-c2c0-48e5-b519-53c9b68c38cd could not be found. {{(pid=98193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:29:40.765895 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-77fc688a-f36a-434d-be47-dde0862c4b3e tempest-ServerRescueNegativeTestJSON-823477256 tempest-ServerRescueNegativeTestJSON-823477256-project] 10.222.0.44 "GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd" status: 404 len: 111 microversion: 2.1 time: 0.085334 Feb 19 02:29:40.766708 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 299/572] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:40 2021] GET /compute/v2.1/servers/c0a55cfa-c2c0-48e5-b519-53c9b68c38cd => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 02:29:40.795435 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-4c8c8bf5-5641-4aa6-9b18-d864aa5814fa tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da5618e5a5640c28593881e6d144469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd5f2d3f10452aa7848bc1d229dfdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:40.805170 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-4c8c8bf5-5641-4aa6-9b18-d864aa5814fa tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "GET /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74" status: 200 len: 1509 microversion: 2.1 time: 0.387603 Feb 19 02:29:40.810661 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 274/573] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:40 2021] GET /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74 => generated 1509 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:41.804122 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-128b5e98-ad95-46c7-95fa-ba78e9bbbcaf tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:41.805356 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-128b5e98-ad95-46c7-95fa-ba78e9bbbcaf tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:41.824810 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-128b5e98-ad95-46c7-95fa-ba78e9bbbcaf tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:41.825655 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-128b5e98-ad95-46c7-95fa-ba78e9bbbcaf tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:41.826952 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-128b5e98-ad95-46c7-95fa-ba78e9bbbcaf tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:41.827651 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-128b5e98-ad95-46c7-95fa-ba78e9bbbcaf tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:42.347226 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.objects.instance [None req-128b5e98-ad95-46c7-95fa-ba78e9bbbcaf tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lazy-loading 'services' on Instance uuid 42f746d8-04b6-4db3-a823-ecff5e8dab6b {{(pid=98193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 02:29:42.734441 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-128b5e98-ad95-46c7-95fa-ba78e9bbbcaf tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "DELETE /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/os-volume_attachments/63444285-7e2a-4670-88d3-2ce36efe8d94" status: 202 len: 0 microversion: 2.1 time: 0.934586 Feb 19 02:29:42.735926 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 300/574] 10.222.0.44 () {58 vars in 1406 bytes} [Fri Feb 19 02:29:41 2021] DELETE /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/os-volume_attachments/63444285-7e2a-4670-88d3-2ce36efe8d94 => generated 0 bytes in 937 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:29:43.157149 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-dfa20844-365e-4a4f-bfc9-f79edd9f25df tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Action: 'create', calling method: .version_select at 0x7f217c54e950>, body: {"keypair": {"name": "tempest-TestShelveInstance-943050906"}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:29:43.185203 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-dfa20844-365e-4a4f-bfc9-f79edd9f25df tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Getting quotas for project e134d1a72aee466e8636d06121d39c09. Resources: {'key_pairs'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:29:43.189400 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-dfa20844-365e-4a4f-bfc9-f79edd9f25df tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Getting quotas for user 62a9445a66a3485b92b1d2e8b3c8ce33 and project e134d1a72aee466e8636d06121d39c09. Resources: {'key_pairs'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:29:43.201978 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dfa20844-365e-4a4f-bfc9-f79edd9f25df tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [3a47e150-5f98-468c-b77f-0bfc106172e3] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 19 02:29:44.067849 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7728b749-762e-44fd-8cb1-64a56a0abe35 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:29:44.078176 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7728b749-762e-44fd-8cb1-64a56a0abe35 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:44.078733 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7728b749-762e-44fd-8cb1-64a56a0abe35 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:44.140541 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7728b749-762e-44fd-8cb1-64a56a0abe35 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Going to try to stop instance {{(pid=98193) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Feb 19 02:29:44.226509 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO oslo.messaging._drivers.impl_rabbit [None req-dfa20844-365e-4a4f-bfc9-f79edd9f25df tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [3a47e150-5f98-468c-b77f-0bfc106172e3] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 48320. Feb 19 02:29:44.239258 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7728b749-762e-44fd-8cb1-64a56a0abe35 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 202 len: 0 microversion: 2.1 time: 0.176246 Feb 19 02:29:44.239930 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 301/575] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:29:44 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 19 02:29:44.258633 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f8015de4-43be-433c-8c6f-7a393059e6ee tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:44.259697 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f8015de4-43be-433c-8c6f-7a393059e6ee tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:44.269307 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f8015de4-43be-433c-8c6f-7a393059e6ee tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:44.270076 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f8015de4-43be-433c-8c6f-7a393059e6ee tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:44.271705 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f8015de4-43be-433c-8c6f-7a393059e6ee tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:44.271705 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f8015de4-43be-433c-8c6f-7a393059e6ee tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:44.744522 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-dfa20844-365e-4a4f-bfc9-f79edd9f25df tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Getting quotas for project e134d1a72aee466e8636d06121d39c09. Resources: {'key_pairs'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:29:44.752070 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-dfa20844-365e-4a4f-bfc9-f79edd9f25df tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Getting quotas for user 62a9445a66a3485b92b1d2e8b3c8ce33 and project e134d1a72aee466e8636d06121d39c09. Resources: {'key_pairs'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:29:44.778657 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-dfa20844-365e-4a4f-bfc9-f79edd9f25df tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 1.939197 Feb 19 02:29:44.779699 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 275/576] 10.222.0.44 () {60 vars in 1148 bytes} [Fri Feb 19 02:29:42 2021] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 1941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:44.791707 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-237586ef-4d4c-4b1f-91a0-466c8c65b22b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Action: 'create', calling method: .version_select at 0x7f217c524840>, body: {"security_group": {"name": "tempest-TestShelveInstance-1022740783", "description": "tempest-TestShelveInstance-1022740783 description"}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:29:45.124900 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-237586ef-4d4c-4b1f-91a0-466c8c65b22b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.337967 Feb 19 02:29:45.125849 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 276/577] 10.222.0.44 () {60 vars in 1170 bytes} [Fri Feb 19 02:29:44 2021] POST /compute/v2.1/os-security-groups => generated 245 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:29:45.139199 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-678173b1-c161-4c23-8d70-0245edf99ad6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Action: 'create', calling method: .version_select at 0x7f217c54e400>, body: {"security_group_rule": {"parent_group_id": "2ae6ce9c-43f2-4e7d-ada0-360d5156cba4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:29:45.425607 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-678173b1-c161-4c23-8d70-0245edf99ad6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.291078 Feb 19 02:29:45.427069 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 277/578] 10.222.0.44 () {60 vars in 1185 bytes} [Fri Feb 19 02:29:45 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:29:45.441333 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-45d85b31-4a3e-49e6-8f37-7a01e0242f13 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Action: 'create', calling method: .version_select at 0x7f217d6c0268>, body: {"security_group_rule": {"parent_group_id": "2ae6ce9c-43f2-4e7d-ada0-360d5156cba4", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:29:45.512151 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f8015de4-43be-433c-8c6f-7a393059e6ee tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:45.531449 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f8015de4-43be-433c-8c6f-7a393059e6ee tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1675 microversion: 2.1 time: 1.279520 Feb 19 02:29:45.532478 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 302/579] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:44 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1675 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:45.726587 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-45d85b31-4a3e-49e6-8f37-7a01e0242f13 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.291146 Feb 19 02:29:45.738379 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 278/580] 10.222.0.44 () {60 vars in 1185 bytes} [Fri Feb 19 02:29:45 2021] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:29:46.552900 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4d5faecd-500f-4cba-ac7e-440793162134 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:46.554141 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-4d5faecd-500f-4cba-ac7e-440793162134 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:46.584379 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4d5faecd-500f-4cba-ac7e-440793162134 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:46.585984 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4d5faecd-500f-4cba-ac7e-440793162134 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:46.587225 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4d5faecd-500f-4cba-ac7e-440793162134 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:46.587882 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4d5faecd-500f-4cba-ac7e-440793162134 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:47.198912 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-4d5faecd-500f-4cba-ac7e-440793162134 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:47.224144 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-4d5faecd-500f-4cba-ac7e-440793162134 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1675 microversion: 2.1 time: 0.676497 Feb 19 02:29:47.224989 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 303/581] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:46 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1675 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:48.243564 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-57f46582-da02-4070-858d-f07b3bb28558 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:48.244343 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-57f46582-da02-4070-858d-f07b3bb28558 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:48.263515 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-57f46582-da02-4070-858d-f07b3bb28558 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:48.264121 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-57f46582-da02-4070-858d-f07b3bb28558 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:48.265123 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-57f46582-da02-4070-858d-f07b3bb28558 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:48.268816 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-57f46582-da02-4070-858d-f07b3bb28558 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:48.560780 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-57f46582-da02-4070-858d-f07b3bb28558 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:48.571339 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-57f46582-da02-4070-858d-f07b3bb28558 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1675 microversion: 2.1 time: 0.331902 Feb 19 02:29:48.572085 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 279/582] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:48 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1675 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:49.590238 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-56c0f897-5535-44f8-ab61-7e52b5a7c167 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:49.591051 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-56c0f897-5535-44f8-ab61-7e52b5a7c167 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:49.601898 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-56c0f897-5535-44f8-ab61-7e52b5a7c167 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:49.602542 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-56c0f897-5535-44f8-ab61-7e52b5a7c167 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:49.604354 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-56c0f897-5535-44f8-ab61-7e52b5a7c167 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:49.605192 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-56c0f897-5535-44f8-ab61-7e52b5a7c167 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:49.920107 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-56c0f897-5535-44f8-ab61-7e52b5a7c167 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:49.930576 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-56c0f897-5535-44f8-ab61-7e52b5a7c167 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1675 microversion: 2.1 time: 0.344623 Feb 19 02:29:49.931792 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 304/583] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:49 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1675 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:50.952972 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c671440b-83a6-4411-905f-8c99b65dd481 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:50.953501 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c671440b-83a6-4411-905f-8c99b65dd481 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:50.962064 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c671440b-83a6-4411-905f-8c99b65dd481 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:50.962638 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c671440b-83a6-4411-905f-8c99b65dd481 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:50.963577 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c671440b-83a6-4411-905f-8c99b65dd481 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:50.963981 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c671440b-83a6-4411-905f-8c99b65dd481 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:51.213022 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c671440b-83a6-4411-905f-8c99b65dd481 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:51.222118 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c671440b-83a6-4411-905f-8c99b65dd481 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1675 microversion: 2.1 time: 0.276285 Feb 19 02:29:51.226417 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 280/584] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:50 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1675 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:52.241953 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-83f0ecf8-dafc-42e2-ace9-ce3f35db9292 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:52.242674 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-83f0ecf8-dafc-42e2-ace9-ce3f35db9292 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:52.250654 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-83f0ecf8-dafc-42e2-ace9-ce3f35db9292 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:52.251170 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-83f0ecf8-dafc-42e2-ace9-ce3f35db9292 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:52.252018 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-83f0ecf8-dafc-42e2-ace9-ce3f35db9292 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:52.252502 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-83f0ecf8-dafc-42e2-ace9-ce3f35db9292 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:52.732914 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-83f0ecf8-dafc-42e2-ace9-ce3f35db9292 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:52.742495 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-83f0ecf8-dafc-42e2-ace9-ce3f35db9292 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1675 microversion: 2.1 time: 0.505067 Feb 19 02:29:52.743116 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 305/585] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:52 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1675 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:53.763772 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-33d54d5e-7f64-459d-a11a-592a1a836734 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:53.764722 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-33d54d5e-7f64-459d-a11a-592a1a836734 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:53.772666 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-33d54d5e-7f64-459d-a11a-592a1a836734 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:53.773373 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-33d54d5e-7f64-459d-a11a-592a1a836734 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:53.774562 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-33d54d5e-7f64-459d-a11a-592a1a836734 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:53.775069 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-33d54d5e-7f64-459d-a11a-592a1a836734 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:54.062407 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-33d54d5e-7f64-459d-a11a-592a1a836734 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:54.085880 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-33d54d5e-7f64-459d-a11a-592a1a836734 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1675 microversion: 2.1 time: 0.326007 Feb 19 02:29:54.087288 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 281/586] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:53 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1675 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:54.355381 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 02:29:54.355551 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: Fri Feb 19 02:29:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 02:29:55.105789 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8ce10213-25a1-4071-b0c9-03640bf4a50a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:55.106488 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8ce10213-25a1-4071-b0c9-03640bf4a50a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:55.114340 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8ce10213-25a1-4071-b0c9-03640bf4a50a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:55.114889 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8ce10213-25a1-4071-b0c9-03640bf4a50a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:55.115810 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8ce10213-25a1-4071-b0c9-03640bf4a50a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:55.116813 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8ce10213-25a1-4071-b0c9-03640bf4a50a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:55.346285 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8ce10213-25a1-4071-b0c9-03640bf4a50a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:55.356446 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8ce10213-25a1-4071-b0c9-03640bf4a50a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1652 microversion: 2.1 time: 0.254761 Feb 19 02:29:55.357327 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 306/587] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:55 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1652 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:55.382397 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-9cad96cb-284a-4e9a-a07b-6e4253a0fd1e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:29:55.390248 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9cad96cb-284a-4e9a-a07b-6e4253a0fd1e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:55.390781 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9cad96cb-284a-4e9a-a07b-6e4253a0fd1e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:55.455047 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-9cad96cb-284a-4e9a-a07b-6e4253a0fd1e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Going to try to start instance {{(pid=98194) start /opt/stack/nova/nova/compute/api.py:2603}} Feb 19 02:29:55.539323 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-9cad96cb-284a-4e9a-a07b-6e4253a0fd1e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action" status: 202 len: 0 microversion: 2.1 time: 0.160710 Feb 19 02:29:55.540031 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 282/588] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:29:55 2021] POST /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:29:55.548656 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d189136b-49d3-47de-b8e9-3bce74b4d23a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:55.549344 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d189136b-49d3-47de-b8e9-3bce74b4d23a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:55.557884 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d189136b-49d3-47de-b8e9-3bce74b4d23a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:55.558406 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d189136b-49d3-47de-b8e9-3bce74b4d23a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:55.559257 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d189136b-49d3-47de-b8e9-3bce74b4d23a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:55.559740 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d189136b-49d3-47de-b8e9-3bce74b4d23a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:55.811256 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-d189136b-49d3-47de-b8e9-3bce74b4d23a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:55.821196 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d189136b-49d3-47de-b8e9-3bce74b4d23a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1661 microversion: 2.1 time: 0.276566 Feb 19 02:29:55.821826 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 307/589] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:55 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1661 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:56.842228 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b7191fc0-16e5-4035-82cd-908a23ae7419 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:56.843038 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b7191fc0-16e5-4035-82cd-908a23ae7419 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:56.851803 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b7191fc0-16e5-4035-82cd-908a23ae7419 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:56.852317 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b7191fc0-16e5-4035-82cd-908a23ae7419 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:56.856643 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b7191fc0-16e5-4035-82cd-908a23ae7419 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:56.857165 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b7191fc0-16e5-4035-82cd-908a23ae7419 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:57.081997 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b7191fc0-16e5-4035-82cd-908a23ae7419 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:57.092914 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b7191fc0-16e5-4035-82cd-908a23ae7419 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1661 microversion: 2.1 time: 0.255116 Feb 19 02:29:57.093552 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 283/590] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:56 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1661 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:29:58.113154 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-05bbfee5-ef43-407a-acc2-e13c60c6a12a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:29:58.113828 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-05bbfee5-ef43-407a-acc2-e13c60c6a12a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:29:58.125001 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-05bbfee5-ef43-407a-acc2-e13c60c6a12a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:58.125435 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-05bbfee5-ef43-407a-acc2-e13c60c6a12a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:58.126302 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-05bbfee5-ef43-407a-acc2-e13c60c6a12a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:29:58.126804 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-05bbfee5-ef43-407a-acc2-e13c60c6a12a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:29:58.366635 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-05bbfee5-ef43-407a-acc2-e13c60c6a12a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:29:58.375825 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-05bbfee5-ef43-407a-acc2-e13c60c6a12a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1665 microversion: 2.1 time: 0.267462 Feb 19 02:29:58.376462 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 308/591] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:29:58 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1665 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:30:01.972225 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ca399f44-fc23-4420-80e3-4d111e241251 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:01.972845 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ca399f44-fc23-4420-80e3-4d111e241251 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:01.981602 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ca399f44-fc23-4420-80e3-4d111e241251 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:01.982323 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ca399f44-fc23-4420-80e3-4d111e241251 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:01.983237 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ca399f44-fc23-4420-80e3-4d111e241251 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:01.983917 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ca399f44-fc23-4420-80e3-4d111e241251 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:02.070476 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ca399f44-fc23-4420-80e3-4d111e241251 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/os-volume_attachments/9c8b601b-b52b-4a25-8ec2-50d990e0d3c5" status: 200 len: 194 microversion: 2.20 time: 0.102437 Feb 19 02:30:02.071143 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 284/592] 10.222.0.44 () {60 vars in 1444 bytes} [Fri Feb 19 02:30:01 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/os-volume_attachments/9c8b601b-b52b-4a25-8ec2-50d990e0d3c5 => generated 194 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:30:02.188804 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1b3003b1-4809-4a35-9688-a9ca6197585b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:02.189348 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1b3003b1-4809-4a35-9688-a9ca6197585b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:02.198370 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1b3003b1-4809-4a35-9688-a9ca6197585b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:02.198969 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1b3003b1-4809-4a35-9688-a9ca6197585b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:02.199862 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1b3003b1-4809-4a35-9688-a9ca6197585b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:02.200356 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1b3003b1-4809-4a35-9688-a9ca6197585b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:02.374718 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.objects.instance [None req-1b3003b1-4809-4a35-9688-a9ca6197585b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lazy-loading 'services' on Instance uuid 5265f377-f5b9-4f2c-a6e8-3bf64fb08733 {{(pid=98193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 02:30:02.519448 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1b3003b1-4809-4a35-9688-a9ca6197585b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/os-volume_attachments/9c8b601b-b52b-4a25-8ec2-50d990e0d3c5" status: 202 len: 0 microversion: 2.20 time: 0.334659 Feb 19 02:30:02.520147 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 309/593] 10.222.0.44 () {60 vars in 1447 bytes} [Fri Feb 19 02:30:02 2021] DELETE /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733/os-volume_attachments/9c8b601b-b52b-4a25-8ec2-50d990e0d3c5 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 19 02:30:07.084792 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-56fe03a4-92e3-4e90-89c4-ca1be71ad4f6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:07.085336 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-56fe03a4-92e3-4e90-89c4-ca1be71ad4f6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:07.093518 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-56fe03a4-92e3-4e90-89c4-ca1be71ad4f6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:07.094021 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-56fe03a4-92e3-4e90-89c4-ca1be71ad4f6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:07.094884 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-56fe03a4-92e3-4e90-89c4-ca1be71ad4f6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:07.095373 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-56fe03a4-92e3-4e90-89c4-ca1be71ad4f6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:07.161026 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-56fe03a4-92e3-4e90-89c4-ca1be71ad4f6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Going to try to terminate instance {{(pid=98194) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 02:30:07.276496 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-56fe03a4-92e3-4e90-89c4-ca1be71ad4f6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 204 len: 0 microversion: 2.20 time: 0.195616 Feb 19 02:30:07.277061 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 285/594] 10.222.0.44 () {60 vars in 1270 bytes} [Fri Feb 19 02:30:07 2021] DELETE /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 19 02:30:07.288033 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a7dec1ac-b205-4fbb-92c7-37a0d1b01977 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:07.289688 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a7dec1ac-b205-4fbb-92c7-37a0d1b01977 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:07.297755 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a7dec1ac-b205-4fbb-92c7-37a0d1b01977 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:07.298257 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a7dec1ac-b205-4fbb-92c7-37a0d1b01977 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:07.299120 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a7dec1ac-b205-4fbb-92c7-37a0d1b01977 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:07.299607 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a7dec1ac-b205-4fbb-92c7-37a0d1b01977 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:07.506557 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a7dec1ac-b205-4fbb-92c7-37a0d1b01977 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:07.515880 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a7dec1ac-b205-4fbb-92c7-37a0d1b01977 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:07.517520 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a7dec1ac-b205-4fbb-92c7-37a0d1b01977 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:07.518818 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a7dec1ac-b205-4fbb-92c7-37a0d1b01977 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1722 microversion: 2.20 time: 0.236981 Feb 19 02:30:07.519442 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 310/595] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:30:07 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:30:08.541074 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ef78b7d6-d210-4809-9828-9a6e1a140c76 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:08.541823 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ef78b7d6-d210-4809-9828-9a6e1a140c76 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:08.549758 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ef78b7d6-d210-4809-9828-9a6e1a140c76 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:08.550264 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ef78b7d6-d210-4809-9828-9a6e1a140c76 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:08.551119 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ef78b7d6-d210-4809-9828-9a6e1a140c76 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:08.551612 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ef78b7d6-d210-4809-9828-9a6e1a140c76 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:08.761479 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ef78b7d6-d210-4809-9828-9a6e1a140c76 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:08.770748 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ef78b7d6-d210-4809-9828-9a6e1a140c76 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:08.772322 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ef78b7d6-d210-4809-9828-9a6e1a140c76 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:08.773542 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ef78b7d6-d210-4809-9828-9a6e1a140c76 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1722 microversion: 2.20 time: 0.237187 Feb 19 02:30:08.774151 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 286/596] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:30:08 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:30:09.792613 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-0123d4cb-ffb5-4762-84de-26075e4b79a1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:09.793285 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-0123d4cb-ffb5-4762-84de-26075e4b79a1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:09.801324 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0123d4cb-ffb5-4762-84de-26075e4b79a1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:09.801836 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0123d4cb-ffb5-4762-84de-26075e4b79a1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:09.802796 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0123d4cb-ffb5-4762-84de-26075e4b79a1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:09.803889 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0123d4cb-ffb5-4762-84de-26075e4b79a1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:10.023548 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-0123d4cb-ffb5-4762-84de-26075e4b79a1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:10.033602 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-0123d4cb-ffb5-4762-84de-26075e4b79a1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:10.035220 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-0123d4cb-ffb5-4762-84de-26075e4b79a1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:10.036474 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-0123d4cb-ffb5-4762-84de-26075e4b79a1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1722 microversion: 2.20 time: 0.248080 Feb 19 02:30:10.037093 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 311/597] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:30:09 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:30:11.056745 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5efb5550-b3a0-451d-b4d4-a25de6078659 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:11.057407 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5efb5550-b3a0-451d-b4d4-a25de6078659 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:11.065472 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5efb5550-b3a0-451d-b4d4-a25de6078659 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:11.065978 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5efb5550-b3a0-451d-b4d4-a25de6078659 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:11.066840 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5efb5550-b3a0-451d-b4d4-a25de6078659 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:11.067334 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5efb5550-b3a0-451d-b4d4-a25de6078659 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:11.283899 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5efb5550-b3a0-451d-b4d4-a25de6078659 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:11.293771 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5efb5550-b3a0-451d-b4d4-a25de6078659 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:11.295388 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5efb5550-b3a0-451d-b4d4-a25de6078659 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:11.296663 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5efb5550-b3a0-451d-b4d4-a25de6078659 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1722 microversion: 2.20 time: 0.243914 Feb 19 02:30:11.297274 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 287/598] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:30:11 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:30:12.318051 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-797ca5ea-1b27-48c0-9b6a-b17d549a267f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:12.320040 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-797ca5ea-1b27-48c0-9b6a-b17d549a267f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:12.332653 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-797ca5ea-1b27-48c0-9b6a-b17d549a267f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:12.333861 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-797ca5ea-1b27-48c0-9b6a-b17d549a267f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:12.335283 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-797ca5ea-1b27-48c0-9b6a-b17d549a267f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:12.335882 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-797ca5ea-1b27-48c0-9b6a-b17d549a267f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:12.561200 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-797ca5ea-1b27-48c0-9b6a-b17d549a267f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:12.573020 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-797ca5ea-1b27-48c0-9b6a-b17d549a267f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:12.575086 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-797ca5ea-1b27-48c0-9b6a-b17d549a267f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:12.576800 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-797ca5ea-1b27-48c0-9b6a-b17d549a267f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1722 microversion: 2.20 time: 0.264228 Feb 19 02:30:12.589284 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 312/599] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:30:12 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1722 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:30:12.651580 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ea91f579-3870-4be2-a337-04c82e0b6ea3 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6130bd13-6c80-4530-bad6-b23b27895a78", "device": "/dev/sdb"}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:30:12.653363 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ea91f579-3870-4be2-a337-04c82e0b6ea3 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2e279104-c2ca-4bf4-872c-2804655e5a74] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:12.661142 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ea91f579-3870-4be2-a337-04c82e0b6ea3 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:12.661624 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ea91f579-3870-4be2-a337-04c82e0b6ea3 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:12.662516 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ea91f579-3870-4be2-a337-04c82e0b6ea3 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:12.663004 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ea91f579-3870-4be2-a337-04c82e0b6ea3 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:13.596269 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-cb276096-7261-479f-b6c6-38d3c5c23cbb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:13.596932 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-cb276096-7261-479f-b6c6-38d3c5c23cbb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:13.605291 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cb276096-7261-479f-b6c6-38d3c5c23cbb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:13.605787 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cb276096-7261-479f-b6c6-38d3c5c23cbb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:13.606637 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cb276096-7261-479f-b6c6-38d3c5c23cbb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:13.607123 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cb276096-7261-479f-b6c6-38d3c5c23cbb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:13.811614 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-cb276096-7261-479f-b6c6-38d3c5c23cbb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:13.820952 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-cb276096-7261-479f-b6c6-38d3c5c23cbb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:13.822557 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-cb276096-7261-479f-b6c6-38d3c5c23cbb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:13.823787 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-cb276096-7261-479f-b6c6-38d3c5c23cbb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1722 microversion: 2.20 time: 0.231553 Feb 19 02:30:13.824402 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 313/600] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:30:13 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 02:30:14.843962 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-85555a5c-c65a-435d-b68d-3816e84afde9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:14.844628 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-85555a5c-c65a-435d-b68d-3816e84afde9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:14.852520 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-85555a5c-c65a-435d-b68d-3816e84afde9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:14.853018 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-85555a5c-c65a-435d-b68d-3816e84afde9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:14.853839 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-85555a5c-c65a-435d-b68d-3816e84afde9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:14.854325 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-85555a5c-c65a-435d-b68d-3816e84afde9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:15.087060 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-85555a5c-c65a-435d-b68d-3816e84afde9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:15.096553 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-85555a5c-c65a-435d-b68d-3816e84afde9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:15.098071 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-85555a5c-c65a-435d-b68d-3816e84afde9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:15.099317 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-85555a5c-c65a-435d-b68d-3816e84afde9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1722 microversion: 2.20 time: 0.259489 Feb 19 02:30:15.100425 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 314/601] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:30:14 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 02:30:16.120873 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1e60cd79-1385-4f26-9367-2648f4a53636 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:16.121545 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1e60cd79-1385-4f26-9367-2648f4a53636 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:16.129587 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1e60cd79-1385-4f26-9367-2648f4a53636 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:16.130109 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1e60cd79-1385-4f26-9367-2648f4a53636 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:16.130983 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1e60cd79-1385-4f26-9367-2648f4a53636 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:16.131483 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1e60cd79-1385-4f26-9367-2648f4a53636 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:16.326851 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ea91f579-3870-4be2-a337-04c82e0b6ea3 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "POST /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.678799 Feb 19 02:30:16.334046 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 288/602] 10.222.0.44 () {60 vars in 1313 bytes} [Fri Feb 19 02:30:12 2021] POST /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74/os-volume_attachments => generated 194 bytes in 3687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:30:16.375859 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-1e60cd79-1385-4f26-9367-2648f4a53636 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:16.378107 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-5249e8a1-7fc3-4a77-9c92-774ca30f4033 req-779717fd-9b03-46da-bb3a-7a43b4de9a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5265f377-f5b9-4f2c-a6e8-3bf64fb08733", "name": "network-vif-unplugged", "status": "completed", "tag": "f7dc3053-2f41-4450-982f-60c5d1f56ee3"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:30:16.380276 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:30:16.380276 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:30:16.389454 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-1e60cd79-1385-4f26-9367-2648f4a53636 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:16.391280 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-1e60cd79-1385-4f26-9367-2648f4a53636 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:16.392539 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1e60cd79-1385-4f26-9367-2648f4a53636 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1722 microversion: 2.20 time: 0.276726 Feb 19 02:30:16.393426 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 315/603] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:30:16 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1722 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 02:30:16.401111 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-5249e8a1-7fc3-4a77-9c92-774ca30f4033 req-779717fd-9b03-46da-bb3a-7a43b4de9a15 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:16.401618 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-5249e8a1-7fc3-4a77-9c92-774ca30f4033 req-779717fd-9b03-46da-bb3a-7a43b4de9a15 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:16.436131 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-5249e8a1-7fc3-4a77-9c92-774ca30f4033 req-779717fd-9b03-46da-bb3a-7a43b4de9a15 service nova] Creating event network-vif-unplugged:f7dc3053-2f41-4450-982f-60c5d1f56ee3 for instance 5265f377-f5b9-4f2c-a6e8-3bf64fb08733 on hv-cinder-77642 Feb 19 02:30:16.462737 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-5249e8a1-7fc3-4a77-9c92-774ca30f4033 req-779717fd-9b03-46da-bb3a-7a43b4de9a15 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078369 Feb 19 02:30:16.463555 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 289/604] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:30:16 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:30:17.414177 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-44fad5c1-d737-4fb7-a00b-c5e2b160bdfd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:17.415122 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-44fad5c1-d737-4fb7-a00b-c5e2b160bdfd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:17.423432 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-44fad5c1-d737-4fb7-a00b-c5e2b160bdfd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:17.424021 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-44fad5c1-d737-4fb7-a00b-c5e2b160bdfd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:17.425031 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-44fad5c1-d737-4fb7-a00b-c5e2b160bdfd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:17.425691 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-44fad5c1-d737-4fb7-a00b-c5e2b160bdfd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:17.554602 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-44fad5c1-d737-4fb7-a00b-c5e2b160bdfd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:17.565969 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-44fad5c1-d737-4fb7-a00b-c5e2b160bdfd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:17.568051 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-44fad5c1-d737-4fb7-a00b-c5e2b160bdfd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:17.569460 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-44fad5c1-d737-4fb7-a00b-c5e2b160bdfd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1655 microversion: 2.20 time: 0.160404 Feb 19 02:30:17.581588 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 316/605] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:30:17 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1655 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:30:18.107742 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-97ed590f-7909-4d11-af30-2c5e7a5efacd req-6f278510-e350-4f2c-a998-e08ec937604e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5265f377-f5b9-4f2c-a6e8-3bf64fb08733", "name": "network-vif-deleted", "tag": "f7dc3053-2f41-4450-982f-60c5d1f56ee3"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:30:18.109924 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:30:18.109924 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:30:18.121428 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-97ed590f-7909-4d11-af30-2c5e7a5efacd req-6f278510-e350-4f2c-a998-e08ec937604e service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:18.122227 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-97ed590f-7909-4d11-af30-2c5e7a5efacd req-6f278510-e350-4f2c-a998-e08ec937604e service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:18.142691 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-97ed590f-7909-4d11-af30-2c5e7a5efacd req-6f278510-e350-4f2c-a998-e08ec937604e service nova] Creating event network-vif-deleted:f7dc3053-2f41-4450-982f-60c5d1f56ee3 for instance 5265f377-f5b9-4f2c-a6e8-3bf64fb08733 on hv-cinder-77642 Feb 19 02:30:18.149433 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-97ed590f-7909-4d11-af30-2c5e7a5efacd req-6f278510-e350-4f2c-a998-e08ec937604e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048369 Feb 19 02:30:18.150232 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 290/606] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:30:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:30:18.590397 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-76a549c8-0134-494b-8860-a8195001c265 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:18.591679 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-76a549c8-0134-494b-8860-a8195001c265 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:18.602294 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-76a549c8-0134-494b-8860-a8195001c265 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:18.603143 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-76a549c8-0134-494b-8860-a8195001c265 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:18.604188 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-76a549c8-0134-494b-8860-a8195001c265 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:18.604879 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-76a549c8-0134-494b-8860-a8195001c265 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:18.737274 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-76a549c8-0134-494b-8860-a8195001c265 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:18.737894 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-76a549c8-0134-494b-8860-a8195001c265 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:18.738524 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.objects.instance [None req-76a549c8-0134-494b-8860-a8195001c265 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lazy-loading 'fault' on Instance uuid 5265f377-f5b9-4f2c-a6e8-3bf64fb08733 {{(pid=98193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 02:30:18.877296 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-76a549c8-0134-494b-8860-a8195001c265 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:18.886942 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-76a549c8-0134-494b-8860-a8195001c265 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:18.888862 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-76a549c8-0134-494b-8860-a8195001c265 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:18.890348 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-76a549c8-0134-494b-8860-a8195001c265 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 200 len: 1370 microversion: 2.20 time: 0.304413 Feb 19 02:30:18.891542 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 317/607] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:30:18 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 1370 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:30:18.998491 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-db0866c9-c9b7-48fb-b495-e15abc510d7d tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2035275235", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-943050906", "security_groups": [{"name": "tempest-TestShelveInstance-1022740783"}], "networks": [{"uuid": "1a196cc5-5370-49d8-b297-9862ae510cb8"}], "block_device_mapping_v2": [{"uuid": "be5c3d49-50bb-4ddf-89d3-db10d4dac193", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:30:19.227948 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-db0866c9-c9b7-48fb-b495-e15abc510d7d tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] validate_networks() for [('1a196cc5-5370-49d8-b297-9862ae510cb8', None, None, None)] {{(pid=98194) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 02:30:19.887647 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-db0866c9-c9b7-48fb-b495-e15abc510d7d tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Flavor limits 0:0:0 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 02:30:19.888274 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-db0866c9-c9b7-48fb-b495-e15abc510d7d tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Image limits 0:0:0 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 02:30:19.889150 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-db0866c9-c9b7-48fb-b495-e15abc510d7d tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Flavor pref 0:0:0 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 02:30:19.889767 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-db0866c9-c9b7-48fb-b495-e15abc510d7d tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Image pref 0:0:0 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 02:30:19.890510 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-db0866c9-c9b7-48fb-b495-e15abc510d7d tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 02:30:19.900290 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-db0866c9-c9b7-48fb-b495-e15abc510d7d tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:19.900930 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-db0866c9-c9b7-48fb-b495-e15abc510d7d tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:19.901884 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-db0866c9-c9b7-48fb-b495-e15abc510d7d tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:19.902517 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-db0866c9-c9b7-48fb-b495-e15abc510d7d tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:19.912385 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-09c741e1-9a58-43f9-8bc6-51cc70443302 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:19.913332 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-09c741e1-9a58-43f9-8bc6-51cc70443302 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:19.921602 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-09c741e1-9a58-43f9-8bc6-51cc70443302 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:19.922283 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-09c741e1-9a58-43f9-8bc6-51cc70443302 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:19.923318 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-09c741e1-9a58-43f9-8bc6-51cc70443302 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:19.924121 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-09c741e1-9a58-43f9-8bc6-51cc70443302 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:19.927362 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-db0866c9-c9b7-48fb-b495-e15abc510d7d tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Getting quotas for project e134d1a72aee466e8636d06121d39c09. Resources: {'ram', 'instances', 'cores'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:30:19.932527 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-db0866c9-c9b7-48fb-b495-e15abc510d7d tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Getting quotas for user 62a9445a66a3485b92b1d2e8b3c8ce33 and project e134d1a72aee466e8636d06121d39c09. Resources: {'ram', 'instances', 'cores'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:30:19.981957 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-09c741e1-9a58-43f9-8bc6-51cc70443302 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] HTTP exception thrown: Instance 5265f377-f5b9-4f2c-a6e8-3bf64fb08733 could not be found. Feb 19 02:30:19.982919 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-09c741e1-9a58-43f9-8bc6-51cc70443302 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Returning 404 to user: Instance 5265f377-f5b9-4f2c-a6e8-3bf64fb08733 could not be found. {{(pid=98193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:30:19.983980 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-09c741e1-9a58-43f9-8bc6-51cc70443302 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 404 len: 111 microversion: 2.20 time: 0.075768 Feb 19 02:30:19.985077 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 318/608] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:30:19 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 19 02:30:19.996226 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-64eaa6bd-6aae-4c27-99d1-85878ac32ee4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '.version_select at 0x7f217cde9268>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:20.043541 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-64eaa6bd-6aae-4c27-99d1-85878ac32ee4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-588318548" status: 204 len: 0 microversion: 2.20 time: 0.053419 Feb 19 02:30:20.044249 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 319/609] 10.222.0.44 () {60 vars in 1249 bytes} [Fri Feb 19 02:30:19 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-588318548 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Feb 19 02:30:20.060034 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-db0866c9-c9b7-48fb-b495-e15abc510d7d tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Going to run 1 instances... {{(pid=98194) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 02:30:20.062583 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-db0866c9-c9b7-48fb-b495-e15abc510d7d tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='be5c3d49-50bb-4ddf-89d3-db10d4dac193',volume_size=None,volume_type=None)] {{(pid=98194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 02:30:20.257610 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-db0866c9-c9b7-48fb-b495-e15abc510d7d tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 410 microversion: 2.1 time: 1.264034 Feb 19 02:30:20.259217 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 291/610] 10.222.0.44 () {60 vars in 1137 bytes} [Fri Feb 19 02:30:18 2021] POST /compute/v2.1/servers => generated 410 bytes in 1266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 19 02:30:20.270075 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-44b3038d-113c-4b0b-ad52-6d922a0ad8fe tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:20.271074 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-44b3038d-113c-4b0b-ad52-6d922a0ad8fe tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:20.506173 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-44b3038d-113c-4b0b-ad52-6d922a0ad8fe tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:20.516957 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-44b3038d-113c-4b0b-ad52-6d922a0ad8fe tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1088 microversion: 2.1 time: 0.251310 Feb 19 02:30:20.528376 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 320/611] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:30:20 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1088 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:30:21.389398 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-04192c90-d2d5-4813-9e0c-de9ada8f5c60 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'create', calling method: .version_select at 0x7f217d6c09d8>, body: {"keypair": {"name": "tempest-keypair-306291204"}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:30:21.412672 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-04192c90-d2d5-4813-9e0c-de9ada8f5c60 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Getting quotas for project c5e1c746a8dc450eb96f1b22cd181e50. Resources: {'key_pairs'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:30:21.416830 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-04192c90-d2d5-4813-9e0c-de9ada8f5c60 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Getting quotas for user 485c785ecc8b41ffa4a9b1e908cb5145 and project c5e1c746a8dc450eb96f1b22cd181e50. Resources: {'key_pairs'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:30:21.535521 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-0091c970-d8ed-4ee3-aafe-c8209b1ad2f9 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:21.536113 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-0091c970-d8ed-4ee3-aafe-c8209b1ad2f9 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:21.544492 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0091c970-d8ed-4ee3-aafe-c8209b1ad2f9 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:21.545001 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0091c970-d8ed-4ee3-aafe-c8209b1ad2f9 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:21.545831 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0091c970-d8ed-4ee3-aafe-c8209b1ad2f9 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:21.546321 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0091c970-d8ed-4ee3-aafe-c8209b1ad2f9 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:21.685380 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-0091c970-d8ed-4ee3-aafe-c8209b1ad2f9 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:21.695453 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-0091c970-d8ed-4ee3-aafe-c8209b1ad2f9 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1194 microversion: 2.1 time: 0.163140 Feb 19 02:30:21.696153 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 321/612] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:30:21 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1194 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:30:21.829089 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-04192c90-d2d5-4813-9e0c-de9ada8f5c60 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Getting quotas for project c5e1c746a8dc450eb96f1b22cd181e50. Resources: {'key_pairs'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:30:21.833106 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-04192c90-d2d5-4813-9e0c-de9ada8f5c60 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Getting quotas for user 485c785ecc8b41ffa4a9b1e908cb5145 and project c5e1c746a8dc450eb96f1b22cd181e50. Resources: {'key_pairs'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:30:21.847072 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-04192c90-d2d5-4813-9e0c-de9ada8f5c60 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.461858 Feb 19 02:30:21.847741 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 292/613] 10.222.0.44 () {62 vars in 1189 bytes} [Fri Feb 19 02:30:21 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 463 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 19 02:30:22.714437 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8bdf67a2-e316-41d9-97b5-c4102ff81784 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:22.715120 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8bdf67a2-e316-41d9-97b5-c4102ff81784 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:22.722833 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8bdf67a2-e316-41d9-97b5-c4102ff81784 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:22.723329 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8bdf67a2-e316-41d9-97b5-c4102ff81784 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:22.724156 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8bdf67a2-e316-41d9-97b5-c4102ff81784 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:22.724639 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8bdf67a2-e316-41d9-97b5-c4102ff81784 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:22.851246 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8bdf67a2-e316-41d9-97b5-c4102ff81784 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:22.860040 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8bdf67a2-e316-41d9-97b5-c4102ff81784 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1194 microversion: 2.1 time: 0.150336 Feb 19 02:30:22.860785 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 322/614] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:30:22 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1194 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:30:23.878479 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8e3c8be6-6898-431e-8055-661c8fae8635 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:23.879187 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8e3c8be6-6898-431e-8055-661c8fae8635 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:23.888608 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8e3c8be6-6898-431e-8055-661c8fae8635 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:23.889104 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8e3c8be6-6898-431e-8055-661c8fae8635 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:23.889934 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8e3c8be6-6898-431e-8055-661c8fae8635 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:23.890445 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8e3c8be6-6898-431e-8055-661c8fae8635 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:23.918075 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7b2b55af-dbff-473c-8630-59d3868434d6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-809673786", "imageRef": "37a0f9d8-d3f7-417e-bce6-371e41a47c88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5b4ec2dc-41c0-4415-958d-7f5e107c8197"}], "security_groups": [{"name": "tempest-securitygroup--1379405300"}], "key_name": "tempest-keypair-306291204", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:30:24.022063 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8e3c8be6-6898-431e-8055-661c8fae8635 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:24.031419 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8e3c8be6-6898-431e-8055-661c8fae8635 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1194 microversion: 2.1 time: 0.157036 Feb 19 02:30:24.032051 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 293/615] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:30:23 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1194 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:30:24.057891 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-7b2b55af-dbff-473c-8630-59d3868434d6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] validate_networks() for [('5b4ec2dc-41c0-4415-958d-7f5e107c8197', None, None, None)] {{(pid=98193) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 02:30:24.680340 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-7b2b55af-dbff-473c-8630-59d3868434d6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Flavor limits 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 02:30:24.681102 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-7b2b55af-dbff-473c-8630-59d3868434d6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Image limits 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 02:30:24.681762 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-7b2b55af-dbff-473c-8630-59d3868434d6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Flavor pref 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 02:30:24.682337 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-7b2b55af-dbff-473c-8630-59d3868434d6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Image pref 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 02:30:24.683188 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-7b2b55af-dbff-473c-8630-59d3868434d6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 02:30:24.692228 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7b2b55af-dbff-473c-8630-59d3868434d6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:24.692782 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7b2b55af-dbff-473c-8630-59d3868434d6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:24.693813 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7b2b55af-dbff-473c-8630-59d3868434d6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:24.694847 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7b2b55af-dbff-473c-8630-59d3868434d6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:24.715039 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-7b2b55af-dbff-473c-8630-59d3868434d6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Getting quotas for project c5e1c746a8dc450eb96f1b22cd181e50. Resources: {'ram', 'instances', 'cores'} {{(pid=98193) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:30:24.719418 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-7b2b55af-dbff-473c-8630-59d3868434d6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Getting quotas for user 485c785ecc8b41ffa4a9b1e908cb5145 and project c5e1c746a8dc450eb96f1b22cd181e50. Resources: {'ram', 'instances', 'cores'} {{(pid=98193) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:30:24.731013 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7b2b55af-dbff-473c-8630-59d3868434d6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Going to run 1 instances... {{(pid=98193) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 02:30:24.733711 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7b2b55af-dbff-473c-8630-59d3868434d6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37a0f9d8-d3f7-417e-bce6-371e41a47c88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 02:30:24.793731 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7b2b55af-dbff-473c-8630-59d3868434d6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.879960 Feb 19 02:30:24.794822 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 323/616] 10.222.0.44 () {62 vars in 1178 bytes} [Fri Feb 19 02:30:23 2021] POST /compute/v2.1/servers => generated 402 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Feb 19 02:30:24.805519 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-0ca46014-cc4a-4ace-82c1-c1fee5667ab2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:24.806277 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-0ca46014-cc4a-4ace-82c1-c1fee5667ab2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:25.050884 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ea5c43e2-367d-415e-bce8-768a6cceaad9 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:25.052135 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ea5c43e2-367d-415e-bce8-768a6cceaad9 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:25.062075 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ea5c43e2-367d-415e-bce8-768a6cceaad9 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:25.062961 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ea5c43e2-367d-415e-bce8-768a6cceaad9 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:25.064353 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ea5c43e2-367d-415e-bce8-768a6cceaad9 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:25.064904 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ea5c43e2-367d-415e-bce8-768a6cceaad9 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:25.072593 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-0ca46014-cc4a-4ace-82c1-c1fee5667ab2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:25.083173 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-0ca46014-cc4a-4ace-82c1-c1fee5667ab2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:25.084797 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-0ca46014-cc4a-4ace-82c1-c1fee5667ab2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:25.086000 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-0ca46014-cc4a-4ace-82c1-c1fee5667ab2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1280 microversion: 2.20 time: 0.284635 Feb 19 02:30:25.086925 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 294/617] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:30:24 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1280 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:30:25.211770 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ea5c43e2-367d-415e-bce8-768a6cceaad9 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:25.222121 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ea5c43e2-367d-415e-bce8-768a6cceaad9 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1204 microversion: 2.1 time: 0.176294 Feb 19 02:30:25.222765 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 324/618] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:30:25 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1204 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:30:26.105826 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7455710c-e69e-4578-b2ee-6fc64dad4850 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:26.106550 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7455710c-e69e-4578-b2ee-6fc64dad4850 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:26.115018 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7455710c-e69e-4578-b2ee-6fc64dad4850 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:26.115531 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7455710c-e69e-4578-b2ee-6fc64dad4850 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:26.117078 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7455710c-e69e-4578-b2ee-6fc64dad4850 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:26.117574 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7455710c-e69e-4578-b2ee-6fc64dad4850 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:26.241694 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5e23f459-a106-4abb-a50b-47e662fd7da8 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:26.242754 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5e23f459-a106-4abb-a50b-47e662fd7da8 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:26.251516 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5e23f459-a106-4abb-a50b-47e662fd7da8 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:26.252031 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5e23f459-a106-4abb-a50b-47e662fd7da8 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:26.252888 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5e23f459-a106-4abb-a50b-47e662fd7da8 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:26.253381 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5e23f459-a106-4abb-a50b-47e662fd7da8 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:26.476183 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7455710c-e69e-4578-b2ee-6fc64dad4850 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:26.486194 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7455710c-e69e-4578-b2ee-6fc64dad4850 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:26.487817 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7455710c-e69e-4578-b2ee-6fc64dad4850 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:26.489144 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7455710c-e69e-4578-b2ee-6fc64dad4850 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1284 microversion: 2.20 time: 0.387334 Feb 19 02:30:26.489749 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 295/619] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:30:26 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1284 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:30:26.497107 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5e23f459-a106-4abb-a50b-47e662fd7da8 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:26.506446 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5e23f459-a106-4abb-a50b-47e662fd7da8 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1276 microversion: 2.1 time: 0.269099 Feb 19 02:30:26.507679 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 325/620] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:30:26 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1276 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:30:27.509304 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-810b924e-975d-4b66-b535-64a89190134e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:27.509937 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-810b924e-975d-4b66-b535-64a89190134e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:27.517928 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-810b924e-975d-4b66-b535-64a89190134e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:27.518434 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-810b924e-975d-4b66-b535-64a89190134e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:27.519257 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-810b924e-975d-4b66-b535-64a89190134e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:27.519920 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-810b924e-975d-4b66-b535-64a89190134e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:27.524917 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f33c169e-d3c4-4465-9442-143a26d308fd tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:27.525594 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f33c169e-d3c4-4465-9442-143a26d308fd tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:27.533516 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f33c169e-d3c4-4465-9442-143a26d308fd tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:27.534028 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f33c169e-d3c4-4465-9442-143a26d308fd tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:27.534916 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f33c169e-d3c4-4465-9442-143a26d308fd tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:27.535411 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f33c169e-d3c4-4465-9442-143a26d308fd tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:27.735011 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-810b924e-975d-4b66-b535-64a89190134e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:27.749827 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-810b924e-975d-4b66-b535-64a89190134e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:27.752316 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-810b924e-975d-4b66-b535-64a89190134e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:27.753514 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-810b924e-975d-4b66-b535-64a89190134e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1332 microversion: 2.20 time: 0.249003 Feb 19 02:30:27.754124 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 296/621] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:30:27 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1332 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:30:27.781102 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f33c169e-d3c4-4465-9442-143a26d308fd tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:27.791700 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f33c169e-d3c4-4465-9442-143a26d308fd tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1276 microversion: 2.1 time: 0.270678 Feb 19 02:30:27.792697 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 326/622] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:30:27 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1276 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:30:28.773301 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-cb31d652-0491-4078-baba-1d334acb85d3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:28.774570 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-cb31d652-0491-4078-baba-1d334acb85d3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:28.782742 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cb31d652-0491-4078-baba-1d334acb85d3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:28.783523 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cb31d652-0491-4078-baba-1d334acb85d3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:28.784557 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cb31d652-0491-4078-baba-1d334acb85d3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:28.785234 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cb31d652-0491-4078-baba-1d334acb85d3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:28.812268 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d837f86a-3311-4414-abdd-528cc125a0bd tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:28.812953 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d837f86a-3311-4414-abdd-528cc125a0bd tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:28.825462 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d837f86a-3311-4414-abdd-528cc125a0bd tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:28.826635 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d837f86a-3311-4414-abdd-528cc125a0bd tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:28.827777 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d837f86a-3311-4414-abdd-528cc125a0bd tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:28.828464 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d837f86a-3311-4414-abdd-528cc125a0bd tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:28.961831 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-cb31d652-0491-4078-baba-1d334acb85d3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:28.974182 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-cb31d652-0491-4078-baba-1d334acb85d3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:28.976118 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-cb31d652-0491-4078-baba-1d334acb85d3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:28.986699 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-cb31d652-0491-4078-baba-1d334acb85d3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1338 microversion: 2.20 time: 0.208246 Feb 19 02:30:28.987907 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 297/623] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:30:28 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1338 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:30:29.103192 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-d837f86a-3311-4414-abdd-528cc125a0bd tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:29.109715 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-91b546fc-605e-41af-944c-9b316892c38f req-21909361-c57c-4f80-9651-cab856585a18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "900317e8-8e9d-49e0-927b-a4d30c204f2c", "tag": "9b55214e-d4a5-4d7f-a090-48b12fdd6991"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:30:29.112407 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:30:29.112407 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:30:29.118791 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d837f86a-3311-4414-abdd-528cc125a0bd tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1264 microversion: 2.1 time: 0.312710 Feb 19 02:30:29.119590 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 327/624] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:30:28 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1264 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:30:29.123679 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-91b546fc-605e-41af-944c-9b316892c38f req-21909361-c57c-4f80-9651-cab856585a18 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:29.124525 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-91b546fc-605e-41af-944c-9b316892c38f req-21909361-c57c-4f80-9651-cab856585a18 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:29.145699 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-91b546fc-605e-41af-944c-9b316892c38f req-21909361-c57c-4f80-9651-cab856585a18 service nova] Creating event network-changed:9b55214e-d4a5-4d7f-a090-48b12fdd6991 for instance 900317e8-8e9d-49e0-927b-a4d30c204f2c on hv-cinder-77642 Feb 19 02:30:29.153116 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-91b546fc-605e-41af-944c-9b316892c38f req-21909361-c57c-4f80-9651-cab856585a18 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049065 Feb 19 02:30:29.154514 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 298/625] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:30:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:30:30.008986 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-9a7a72ba-caac-4ed7-b4c6-a7cb6e7c6a4e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:30.010286 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-9a7a72ba-caac-4ed7-b4c6-a7cb6e7c6a4e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:30.018568 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a7a72ba-caac-4ed7-b4c6-a7cb6e7c6a4e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:30.019080 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a7a72ba-caac-4ed7-b4c6-a7cb6e7c6a4e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:30.019933 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a7a72ba-caac-4ed7-b4c6-a7cb6e7c6a4e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:30.020423 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a7a72ba-caac-4ed7-b4c6-a7cb6e7c6a4e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:30.140503 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-965d4151-2ec6-4a61-a3a8-2966c3d95570 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:30.141582 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-965d4151-2ec6-4a61-a3a8-2966c3d95570 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:30.161079 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-965d4151-2ec6-4a61-a3a8-2966c3d95570 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:30.164370 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-965d4151-2ec6-4a61-a3a8-2966c3d95570 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:30.165517 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-965d4151-2ec6-4a61-a3a8-2966c3d95570 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:30.166194 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-965d4151-2ec6-4a61-a3a8-2966c3d95570 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:30.277316 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9a7a72ba-caac-4ed7-b4c6-a7cb6e7c6a4e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:30.295377 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9a7a72ba-caac-4ed7-b4c6-a7cb6e7c6a4e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:30.297162 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9a7a72ba-caac-4ed7-b4c6-a7cb6e7c6a4e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:30.298562 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-9a7a72ba-caac-4ed7-b4c6-a7cb6e7c6a4e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1406 microversion: 2.20 time: 0.294347 Feb 19 02:30:30.299328 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 328/626] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:30:30 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1406 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:30:30.686628 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-965d4151-2ec6-4a61-a3a8-2966c3d95570 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:30.695873 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-965d4151-2ec6-4a61-a3a8-2966c3d95570 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1264 microversion: 2.1 time: 0.560890 Feb 19 02:30:30.696504 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 299/627] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:30:30 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1264 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:30:31.323072 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-74a3d411-81cf-440a-9ae3-a2416862d1f5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:31.323656 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-74a3d411-81cf-440a-9ae3-a2416862d1f5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:31.331868 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-74a3d411-81cf-440a-9ae3-a2416862d1f5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:31.332630 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-74a3d411-81cf-440a-9ae3-a2416862d1f5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:31.333202 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-74a3d411-81cf-440a-9ae3-a2416862d1f5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:31.333618 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-74a3d411-81cf-440a-9ae3-a2416862d1f5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:31.556392 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-74a3d411-81cf-440a-9ae3-a2416862d1f5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:31.565743 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-74a3d411-81cf-440a-9ae3-a2416862d1f5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:31.567332 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-74a3d411-81cf-440a-9ae3-a2416862d1f5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:31.568515 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-74a3d411-81cf-440a-9ae3-a2416862d1f5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1406 microversion: 2.20 time: 0.250107 Feb 19 02:30:31.569098 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 329/628] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:30:31 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:30:31.714684 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f9088b0c-0466-498e-b8f3-6ec91f2699fe tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:31.715460 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f9088b0c-0466-498e-b8f3-6ec91f2699fe tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:31.723273 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f9088b0c-0466-498e-b8f3-6ec91f2699fe tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:31.723771 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f9088b0c-0466-498e-b8f3-6ec91f2699fe tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:31.724594 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f9088b0c-0466-498e-b8f3-6ec91f2699fe tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:31.725074 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f9088b0c-0466-498e-b8f3-6ec91f2699fe tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:31.935163 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f9088b0c-0466-498e-b8f3-6ec91f2699fe tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:31.944273 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f9088b0c-0466-498e-b8f3-6ec91f2699fe tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1264 microversion: 2.1 time: 0.234337 Feb 19 02:30:31.944897 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 300/629] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:30:31 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1264 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:30:32.589150 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1ae48f80-20b4-4aab-961d-95ce4c535145 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:32.591018 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1ae48f80-20b4-4aab-961d-95ce4c535145 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:32.599547 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1ae48f80-20b4-4aab-961d-95ce4c535145 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:32.601558 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1ae48f80-20b4-4aab-961d-95ce4c535145 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:32.602654 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1ae48f80-20b4-4aab-961d-95ce4c535145 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:32.603634 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1ae48f80-20b4-4aab-961d-95ce4c535145 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:32.886222 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-1ae48f80-20b4-4aab-961d-95ce4c535145 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:32.903315 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-1ae48f80-20b4-4aab-961d-95ce4c535145 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:32.904951 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-1ae48f80-20b4-4aab-961d-95ce4c535145 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:32.906136 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1ae48f80-20b4-4aab-961d-95ce4c535145 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1406 microversion: 2.20 time: 0.322031 Feb 19 02:30:32.907314 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 330/630] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:30:32 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1406 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:30:32.964037 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ae42abcb-cdd6-4df7-945b-302b83303a7c tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:32.964683 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ae42abcb-cdd6-4df7-945b-302b83303a7c tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:32.975060 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ae42abcb-cdd6-4df7-945b-302b83303a7c tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:32.975868 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ae42abcb-cdd6-4df7-945b-302b83303a7c tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:32.977169 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ae42abcb-cdd6-4df7-945b-302b83303a7c tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:32.977839 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ae42abcb-cdd6-4df7-945b-302b83303a7c tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:33.455885 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ae42abcb-cdd6-4df7-945b-302b83303a7c tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:33.466136 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ae42abcb-cdd6-4df7-945b-302b83303a7c tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1264 microversion: 2.1 time: 0.507553 Feb 19 02:30:33.479359 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 301/631] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:30:32 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1264 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:30:33.926877 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e7ae53aa-ef63-4553-8dc4-2e2f98add6f6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:33.927400 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e7ae53aa-ef63-4553-8dc4-2e2f98add6f6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:33.949782 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-bb7ff46b-42b6-4359-9227-edb6d684b8f3 req-af2cf850-4ff4-4c07-b722-bd924759f37f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb5c58f3-abb6-4bda-8928-db72606dcefd", "tag": "c6e75aba-17c0-47ae-b251-61c34117a52a"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:30:33.951949 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:30:33.951949 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:30:33.961574 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e7ae53aa-ef63-4553-8dc4-2e2f98add6f6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:33.962325 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e7ae53aa-ef63-4553-8dc4-2e2f98add6f6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:33.964630 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-bb7ff46b-42b6-4359-9227-edb6d684b8f3 req-af2cf850-4ff4-4c07-b722-bd924759f37f service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:33.965047 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e7ae53aa-ef63-4553-8dc4-2e2f98add6f6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:33.965514 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-bb7ff46b-42b6-4359-9227-edb6d684b8f3 req-af2cf850-4ff4-4c07-b722-bd924759f37f service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:33.965782 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e7ae53aa-ef63-4553-8dc4-2e2f98add6f6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:34.009730 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-bb7ff46b-42b6-4359-9227-edb6d684b8f3 req-af2cf850-4ff4-4c07-b722-bd924759f37f service nova] Creating event network-changed:c6e75aba-17c0-47ae-b251-61c34117a52a for instance eb5c58f3-abb6-4bda-8928-db72606dcefd on hv-cinder-77642 Feb 19 02:30:34.025814 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-bb7ff46b-42b6-4359-9227-edb6d684b8f3 req-af2cf850-4ff4-4c07-b722-bd924759f37f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079925 Feb 19 02:30:34.026548 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 302/632] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:30:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:30:34.246062 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e7ae53aa-ef63-4553-8dc4-2e2f98add6f6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:34.255705 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e7ae53aa-ef63-4553-8dc4-2e2f98add6f6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:34.257857 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e7ae53aa-ef63-4553-8dc4-2e2f98add6f6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:34.259104 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e7ae53aa-ef63-4553-8dc4-2e2f98add6f6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1406 microversion: 2.20 time: 0.337476 Feb 19 02:30:34.259733 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 331/633] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:30:33 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1406 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:30:34.486058 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ba9e108e-d208-46e8-b618-8f16224e4986 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:34.486887 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ba9e108e-d208-46e8-b618-8f16224e4986 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:34.495734 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ba9e108e-d208-46e8-b618-8f16224e4986 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:34.496243 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ba9e108e-d208-46e8-b618-8f16224e4986 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:34.497092 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ba9e108e-d208-46e8-b618-8f16224e4986 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:34.497565 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ba9e108e-d208-46e8-b618-8f16224e4986 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:34.758776 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ba9e108e-d208-46e8-b618-8f16224e4986 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:34.767829 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ba9e108e-d208-46e8-b618-8f16224e4986 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1264 microversion: 2.1 time: 0.286163 Feb 19 02:30:34.768448 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 303/634] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:30:34 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1264 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:30:35.278623 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-97bf1fe1-2dec-4a44-a03e-03ba24ee55ee tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:35.279790 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-97bf1fe1-2dec-4a44-a03e-03ba24ee55ee tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:35.291264 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-97bf1fe1-2dec-4a44-a03e-03ba24ee55ee tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:35.291771 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-97bf1fe1-2dec-4a44-a03e-03ba24ee55ee tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:35.292620 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-97bf1fe1-2dec-4a44-a03e-03ba24ee55ee tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:35.294679 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-97bf1fe1-2dec-4a44-a03e-03ba24ee55ee tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:35.533059 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-97bf1fe1-2dec-4a44-a03e-03ba24ee55ee tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:35.543175 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-97bf1fe1-2dec-4a44-a03e-03ba24ee55ee tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:35.544793 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-97bf1fe1-2dec-4a44-a03e-03ba24ee55ee tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:35.545944 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-97bf1fe1-2dec-4a44-a03e-03ba24ee55ee tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1406 microversion: 2.20 time: 0.271406 Feb 19 02:30:35.546581 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 332/635] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:30:35 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1406 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:30:35.787352 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-61388f0a-3e66-47a8-806a-565c7c60c456 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:35.788553 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-61388f0a-3e66-47a8-806a-565c7c60c456 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:35.797535 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-61388f0a-3e66-47a8-806a-565c7c60c456 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:35.798040 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-61388f0a-3e66-47a8-806a-565c7c60c456 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:35.798882 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-61388f0a-3e66-47a8-806a-565c7c60c456 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:35.799536 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-61388f0a-3e66-47a8-806a-565c7c60c456 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:36.566001 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4ccd5113-96e8-4076-a7c8-5da8edac2fe5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:36.566623 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-4ccd5113-96e8-4076-a7c8-5da8edac2fe5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:36.575063 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4ccd5113-96e8-4076-a7c8-5da8edac2fe5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:36.575572 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4ccd5113-96e8-4076-a7c8-5da8edac2fe5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:36.576673 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4ccd5113-96e8-4076-a7c8-5da8edac2fe5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:36.577161 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4ccd5113-96e8-4076-a7c8-5da8edac2fe5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:36.649831 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-61388f0a-3e66-47a8-806a-565c7c60c456 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:36.663274 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-61388f0a-3e66-47a8-806a-565c7c60c456 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1264 microversion: 2.1 time: 0.879046 Feb 19 02:30:36.664477 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 304/636] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:30:35 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1264 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:30:36.812409 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-4ccd5113-96e8-4076-a7c8-5da8edac2fe5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:36.822815 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-4ccd5113-96e8-4076-a7c8-5da8edac2fe5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:36.824495 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-4ccd5113-96e8-4076-a7c8-5da8edac2fe5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:36.826423 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-4ccd5113-96e8-4076-a7c8-5da8edac2fe5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1406 microversion: 2.20 time: 0.264355 Feb 19 02:30:36.827237 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 333/637] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:30:36 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1406 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 02:30:37.682042 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-71dfd6ac-a1ed-48d9-8b27-761d9ad8bea7 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:37.682721 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-71dfd6ac-a1ed-48d9-8b27-761d9ad8bea7 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:37.690893 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-71dfd6ac-a1ed-48d9-8b27-761d9ad8bea7 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:37.691405 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-71dfd6ac-a1ed-48d9-8b27-761d9ad8bea7 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:37.692248 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-71dfd6ac-a1ed-48d9-8b27-761d9ad8bea7 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:37.692736 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-71dfd6ac-a1ed-48d9-8b27-761d9ad8bea7 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:37.846756 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-640c901e-9f57-418a-8d75-82e1563389eb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:37.847416 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-640c901e-9f57-418a-8d75-82e1563389eb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:37.855394 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-640c901e-9f57-418a-8d75-82e1563389eb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:37.855898 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-640c901e-9f57-418a-8d75-82e1563389eb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:37.856731 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-640c901e-9f57-418a-8d75-82e1563389eb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:37.857211 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-640c901e-9f57-418a-8d75-82e1563389eb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:37.925348 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-71dfd6ac-a1ed-48d9-8b27-761d9ad8bea7 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:37.937913 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-71dfd6ac-a1ed-48d9-8b27-761d9ad8bea7 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1264 microversion: 2.1 time: 0.260374 Feb 19 02:30:37.938967 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 305/638] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:30:37 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1264 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:30:38.088578 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-640c901e-9f57-418a-8d75-82e1563389eb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:38.098267 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-640c901e-9f57-418a-8d75-82e1563389eb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:38.099938 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-640c901e-9f57-418a-8d75-82e1563389eb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:38.101729 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-640c901e-9f57-418a-8d75-82e1563389eb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1406 microversion: 2.20 time: 0.258975 Feb 19 02:30:38.102409 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 334/639] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:30:37 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1406 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:30:38.962193 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-11639327-fd65-4563-9036-b4ead8c48af8 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:38.963096 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-11639327-fd65-4563-9036-b4ead8c48af8 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:38.971899 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-11639327-fd65-4563-9036-b4ead8c48af8 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:38.972401 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-11639327-fd65-4563-9036-b4ead8c48af8 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:38.973243 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-11639327-fd65-4563-9036-b4ead8c48af8 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:38.973785 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-11639327-fd65-4563-9036-b4ead8c48af8 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:39.121182 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-20a2f570-7852-48df-a1f7-5d5ca3bd93bd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:39.121839 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-20a2f570-7852-48df-a1f7-5d5ca3bd93bd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:39.129615 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-20a2f570-7852-48df-a1f7-5d5ca3bd93bd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:39.130312 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-20a2f570-7852-48df-a1f7-5d5ca3bd93bd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:39.131184 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-20a2f570-7852-48df-a1f7-5d5ca3bd93bd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:39.131840 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-20a2f570-7852-48df-a1f7-5d5ca3bd93bd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:39.200555 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-11639327-fd65-4563-9036-b4ead8c48af8 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:39.211557 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-11639327-fd65-4563-9036-b4ead8c48af8 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1264 microversion: 2.1 time: 0.258857 Feb 19 02:30:39.212171 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 306/640] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:30:38 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1264 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:30:39.353029 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-20a2f570-7852-48df-a1f7-5d5ca3bd93bd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:39.362922 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-20a2f570-7852-48df-a1f7-5d5ca3bd93bd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:39.364487 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-20a2f570-7852-48df-a1f7-5d5ca3bd93bd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:39.365641 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-20a2f570-7852-48df-a1f7-5d5ca3bd93bd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1406 microversion: 2.20 time: 0.248838 Feb 19 02:30:39.366250 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 335/641] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:30:39 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1406 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:30:40.229656 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8332eed6-d94e-48fb-a0ea-402ac124f590 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:40.230268 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8332eed6-d94e-48fb-a0ea-402ac124f590 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:40.238135 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8332eed6-d94e-48fb-a0ea-402ac124f590 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:40.238669 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8332eed6-d94e-48fb-a0ea-402ac124f590 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:40.239502 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8332eed6-d94e-48fb-a0ea-402ac124f590 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:40.239986 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8332eed6-d94e-48fb-a0ea-402ac124f590 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:40.385295 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-bf3bcbe8-15ce-4cc3-9410-af4ad12f2efe tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:40.385990 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-bf3bcbe8-15ce-4cc3-9410-af4ad12f2efe tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:40.393813 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bf3bcbe8-15ce-4cc3-9410-af4ad12f2efe tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:40.394324 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bf3bcbe8-15ce-4cc3-9410-af4ad12f2efe tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:40.395208 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bf3bcbe8-15ce-4cc3-9410-af4ad12f2efe tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:40.395703 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bf3bcbe8-15ce-4cc3-9410-af4ad12f2efe tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:40.455476 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8332eed6-d94e-48fb-a0ea-402ac124f590 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:40.465490 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8332eed6-d94e-48fb-a0ea-402ac124f590 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1264 microversion: 2.1 time: 0.239846 Feb 19 02:30:40.468329 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 307/642] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:30:40 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1264 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:30:40.608858 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-bf3bcbe8-15ce-4cc3-9410-af4ad12f2efe tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:40.618305 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-bf3bcbe8-15ce-4cc3-9410-af4ad12f2efe tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:40.619949 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-bf3bcbe8-15ce-4cc3-9410-af4ad12f2efe tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:40.621116 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-bf3bcbe8-15ce-4cc3-9410-af4ad12f2efe tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1406 microversion: 2.20 time: 0.239986 Feb 19 02:30:40.621746 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 336/643] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:30:40 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 02:30:41.485473 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-3da467aa-af9f-4eb7-b813-3ba1fc1e1637 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:41.486143 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-3da467aa-af9f-4eb7-b813-3ba1fc1e1637 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:41.494748 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3da467aa-af9f-4eb7-b813-3ba1fc1e1637 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:41.495256 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3da467aa-af9f-4eb7-b813-3ba1fc1e1637 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:41.496088 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3da467aa-af9f-4eb7-b813-3ba1fc1e1637 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:41.496573 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3da467aa-af9f-4eb7-b813-3ba1fc1e1637 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:41.640375 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-41bdf7cb-6a11-46d2-b1e0-11bad7506384 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:41.641038 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-41bdf7cb-6a11-46d2-b1e0-11bad7506384 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:41.649837 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-41bdf7cb-6a11-46d2-b1e0-11bad7506384 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:41.650513 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-41bdf7cb-6a11-46d2-b1e0-11bad7506384 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:41.651344 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-41bdf7cb-6a11-46d2-b1e0-11bad7506384 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:41.651834 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-41bdf7cb-6a11-46d2-b1e0-11bad7506384 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:41.719461 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-3da467aa-af9f-4eb7-b813-3ba1fc1e1637 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:41.729501 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-3da467aa-af9f-4eb7-b813-3ba1fc1e1637 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1264 microversion: 2.1 time: 0.248980 Feb 19 02:30:41.730137 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 308/644] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:30:41 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1264 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:30:41.877088 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-41bdf7cb-6a11-46d2-b1e0-11bad7506384 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:41.888375 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-41bdf7cb-6a11-46d2-b1e0-11bad7506384 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:41.889996 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-41bdf7cb-6a11-46d2-b1e0-11bad7506384 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:41.891209 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-41bdf7cb-6a11-46d2-b1e0-11bad7506384 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1406 microversion: 2.20 time: 0.255061 Feb 19 02:30:41.891887 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 337/645] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:30:41 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1406 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:30:42.748198 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a5f17422-d22a-4c38-a51d-ca327e021927 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:42.748866 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a5f17422-d22a-4c38-a51d-ca327e021927 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:42.756767 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a5f17422-d22a-4c38-a51d-ca327e021927 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:42.757271 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a5f17422-d22a-4c38-a51d-ca327e021927 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:42.758104 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a5f17422-d22a-4c38-a51d-ca327e021927 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:42.758623 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a5f17422-d22a-4c38-a51d-ca327e021927 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:42.911699 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7fe2d891-01b9-43c5-ac50-7cbe3dfd513e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:42.912353 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7fe2d891-01b9-43c5-ac50-7cbe3dfd513e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:42.922293 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7fe2d891-01b9-43c5-ac50-7cbe3dfd513e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:42.923045 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7fe2d891-01b9-43c5-ac50-7cbe3dfd513e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:42.924217 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7fe2d891-01b9-43c5-ac50-7cbe3dfd513e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:42.924900 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7fe2d891-01b9-43c5-ac50-7cbe3dfd513e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:42.979530 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a5f17422-d22a-4c38-a51d-ca327e021927 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:42.988685 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a5f17422-d22a-4c38-a51d-ca327e021927 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1264 microversion: 2.1 time: 0.244539 Feb 19 02:30:42.989337 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 309/646] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:30:42 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1264 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:30:43.139652 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7fe2d891-01b9-43c5-ac50-7cbe3dfd513e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:43.150739 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7fe2d891-01b9-43c5-ac50-7cbe3dfd513e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:43.152444 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7fe2d891-01b9-43c5-ac50-7cbe3dfd513e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:43.153643 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7fe2d891-01b9-43c5-ac50-7cbe3dfd513e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1406 microversion: 2.20 time: 0.246154 Feb 19 02:30:43.154262 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 338/647] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:30:42 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1406 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:30:44.007473 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5e92651d-1f33-4445-9ce6-6a952409d62f tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:44.008230 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5e92651d-1f33-4445-9ce6-6a952409d62f tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:44.017287 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5e92651d-1f33-4445-9ce6-6a952409d62f tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:44.017884 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5e92651d-1f33-4445-9ce6-6a952409d62f tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:44.019030 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5e92651d-1f33-4445-9ce6-6a952409d62f tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:44.019941 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5e92651d-1f33-4445-9ce6-6a952409d62f tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:44.116849 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-b0e019e6-a7fe-4082-a51f-911692978e43 req-6f97b6a4-ee84-4ab6-9d38-1b4ef98db306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb5c58f3-abb6-4bda-8928-db72606dcefd", "name": "network-vif-plugged", "status": "completed", "tag": "c6e75aba-17c0-47ae-b251-61c34117a52a"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:30:44.119244 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:30:44.119244 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:30:44.130223 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-b0e019e6-a7fe-4082-a51f-911692978e43 req-6f97b6a4-ee84-4ab6-9d38-1b4ef98db306 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:44.131086 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-b0e019e6-a7fe-4082-a51f-911692978e43 req-6f97b6a4-ee84-4ab6-9d38-1b4ef98db306 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:44.154194 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-b0e019e6-a7fe-4082-a51f-911692978e43 req-6f97b6a4-ee84-4ab6-9d38-1b4ef98db306 service nova] Creating event network-vif-plugged:c6e75aba-17c0-47ae-b251-61c34117a52a for instance eb5c58f3-abb6-4bda-8928-db72606dcefd on hv-cinder-77642 Feb 19 02:30:44.161728 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-b0e019e6-a7fe-4082-a51f-911692978e43 req-6f97b6a4-ee84-4ab6-9d38-1b4ef98db306 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049365 Feb 19 02:30:44.162865 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 339/648] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:30:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:30:44.201658 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-703e4b34-2ca2-4ad6-b0f0-f495657d6662 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:44.202507 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-703e4b34-2ca2-4ad6-b0f0-f495657d6662 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:44.226185 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-703e4b34-2ca2-4ad6-b0f0-f495657d6662 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:44.226898 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-703e4b34-2ca2-4ad6-b0f0-f495657d6662 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:44.229688 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-703e4b34-2ca2-4ad6-b0f0-f495657d6662 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:44.230492 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-703e4b34-2ca2-4ad6-b0f0-f495657d6662 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:44.329303 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5e92651d-1f33-4445-9ce6-6a952409d62f tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:44.341133 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5e92651d-1f33-4445-9ce6-6a952409d62f tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1264 microversion: 2.1 time: 0.338282 Feb 19 02:30:44.348085 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 310/649] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:30:44 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1264 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:30:44.773920 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-703e4b34-2ca2-4ad6-b0f0-f495657d6662 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:44.783879 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-703e4b34-2ca2-4ad6-b0f0-f495657d6662 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:44.803831 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-703e4b34-2ca2-4ad6-b0f0-f495657d6662 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:44.805069 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-703e4b34-2ca2-4ad6-b0f0-f495657d6662 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1406 microversion: 2.20 time: 0.634899 Feb 19 02:30:44.805680 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 340/650] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:30:44 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1406 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:30:45.097750 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-58a50b16-5de6-4e2d-9b99-000f9a92dc68 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:45.098976 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-58a50b16-5de6-4e2d-9b99-000f9a92dc68 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2e279104-c2ca-4bf4-872c-2804655e5a74] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:45.107512 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-58a50b16-5de6-4e2d-9b99-000f9a92dc68 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:45.107998 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-58a50b16-5de6-4e2d-9b99-000f9a92dc68 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:45.109031 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-58a50b16-5de6-4e2d-9b99-000f9a92dc68 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:45.109517 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-58a50b16-5de6-4e2d-9b99-000f9a92dc68 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:45.306694 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.objects.instance [None req-58a50b16-5de6-4e2d-9b99-000f9a92dc68 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lazy-loading 'services' on Instance uuid 2e279104-c2ca-4bf4-872c-2804655e5a74 {{(pid=98194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 02:30:45.365448 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d862c036-af8c-4780-953c-fcf2dc45748d tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:45.366716 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d862c036-af8c-4780-953c-fcf2dc45748d tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:45.387136 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d862c036-af8c-4780-953c-fcf2dc45748d tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:45.387836 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d862c036-af8c-4780-953c-fcf2dc45748d tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:45.388865 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d862c036-af8c-4780-953c-fcf2dc45748d tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:45.389513 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d862c036-af8c-4780-953c-fcf2dc45748d tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:45.481300 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-58a50b16-5de6-4e2d-9b99-000f9a92dc68 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "DELETE /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74/os-volume_attachments/6130bd13-6c80-4530-bad6-b23b27895a78" status: 202 len: 0 microversion: 2.1 time: 0.387110 Feb 19 02:30:45.482411 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 311/651] 10.222.0.44 () {58 vars in 1406 bytes} [Fri Feb 19 02:30:45 2021] DELETE /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74/os-volume_attachments/6130bd13-6c80-4530-bad6-b23b27895a78 => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:30:45.646889 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-d862c036-af8c-4780-953c-fcf2dc45748d tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:45.656534 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d862c036-af8c-4780-953c-fcf2dc45748d tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1264 microversion: 2.1 time: 0.295168 Feb 19 02:30:45.657144 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 341/652] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:30:45 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1264 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:30:45.825758 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b78dbb02-4016-42f9-a2de-14d25f1b1dc7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:45.827250 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b78dbb02-4016-42f9-a2de-14d25f1b1dc7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:45.835279 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b78dbb02-4016-42f9-a2de-14d25f1b1dc7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:45.835781 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b78dbb02-4016-42f9-a2de-14d25f1b1dc7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:45.836805 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b78dbb02-4016-42f9-a2de-14d25f1b1dc7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:45.837285 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b78dbb02-4016-42f9-a2de-14d25f1b1dc7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:46.207712 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b78dbb02-4016-42f9-a2de-14d25f1b1dc7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:46.220982 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b78dbb02-4016-42f9-a2de-14d25f1b1dc7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:46.222617 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b78dbb02-4016-42f9-a2de-14d25f1b1dc7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:46.223852 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b78dbb02-4016-42f9-a2de-14d25f1b1dc7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1406 microversion: 2.20 time: 0.402992 Feb 19 02:30:46.224357 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 312/653] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:30:45 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1406 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:30:46.508414 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-7fc9ce59-03d8-4ebd-917d-f5d6eb9cef9f req-2e4361bc-01c0-4514-98c5-0a8289d5b083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "900317e8-8e9d-49e0-927b-a4d30c204f2c", "name": "network-vif-plugged", "status": "completed", "tag": "9b55214e-d4a5-4d7f-a090-48b12fdd6991"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:30:46.510420 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:30:46.510420 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:30:46.521130 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-7fc9ce59-03d8-4ebd-917d-f5d6eb9cef9f req-2e4361bc-01c0-4514-98c5-0a8289d5b083 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:46.521631 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-7fc9ce59-03d8-4ebd-917d-f5d6eb9cef9f req-2e4361bc-01c0-4514-98c5-0a8289d5b083 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:46.542526 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-7fc9ce59-03d8-4ebd-917d-f5d6eb9cef9f req-2e4361bc-01c0-4514-98c5-0a8289d5b083 service nova] Creating event network-vif-plugged:9b55214e-d4a5-4d7f-a090-48b12fdd6991 for instance 900317e8-8e9d-49e0-927b-a4d30c204f2c on hv-cinder-77642 Feb 19 02:30:46.548555 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-7fc9ce59-03d8-4ebd-917d-f5d6eb9cef9f req-2e4361bc-01c0-4514-98c5-0a8289d5b083 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044267 Feb 19 02:30:46.549338 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 342/654] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:30:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:30:46.673680 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-dd3a40a9-285f-467f-9da8-36d75d2ffff6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:46.674370 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-dd3a40a9-285f-467f-9da8-36d75d2ffff6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:46.682667 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dd3a40a9-285f-467f-9da8-36d75d2ffff6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:46.683176 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dd3a40a9-285f-467f-9da8-36d75d2ffff6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:46.684029 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dd3a40a9-285f-467f-9da8-36d75d2ffff6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:46.684522 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dd3a40a9-285f-467f-9da8-36d75d2ffff6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:46.769709 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d76d5ec0-6a35-4c82-8ec2-5c450da0d307 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:46.770610 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d76d5ec0-6a35-4c82-8ec2-5c450da0d307 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2e279104-c2ca-4bf4-872c-2804655e5a74] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:46.781551 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d76d5ec0-6a35-4c82-8ec2-5c450da0d307 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:46.782310 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d76d5ec0-6a35-4c82-8ec2-5c450da0d307 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:46.783376 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d76d5ec0-6a35-4c82-8ec2-5c450da0d307 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:46.784165 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d76d5ec0-6a35-4c82-8ec2-5c450da0d307 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:46.862166 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d76d5ec0-6a35-4c82-8ec2-5c450da0d307 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2e279104-c2ca-4bf4-872c-2804655e5a74] Going to try to terminate instance {{(pid=98193) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 02:30:46.999620 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-dd3a40a9-285f-467f-9da8-36d75d2ffff6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:47.010072 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d76d5ec0-6a35-4c82-8ec2-5c450da0d307 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "DELETE /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74" status: 204 len: 0 microversion: 2.1 time: 0.244586 Feb 19 02:30:47.010742 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-dd3a40a9-285f-467f-9da8-36d75d2ffff6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1264 microversion: 2.1 time: 0.340326 Feb 19 02:30:47.011403 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 313/655] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:30:46 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1264 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:30:47.021050 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 343/656] 10.222.0.44 () {58 vars in 1229 bytes} [Fri Feb 19 02:30:46 2021] DELETE /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 02:30:47.030240 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7f1c1d9a-1295-49f5-a374-068592eeb84b tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:47.031503 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7f1c1d9a-1295-49f5-a374-068592eeb84b tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2e279104-c2ca-4bf4-872c-2804655e5a74] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:47.042312 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7f1c1d9a-1295-49f5-a374-068592eeb84b tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:47.043016 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7f1c1d9a-1295-49f5-a374-068592eeb84b tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:47.044039 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7f1c1d9a-1295-49f5-a374-068592eeb84b tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:47.044680 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7f1c1d9a-1295-49f5-a374-068592eeb84b tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:47.245514 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4bb2c157-9448-4468-8f11-444537d3b95c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:47.264078 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-4bb2c157-9448-4468-8f11-444537d3b95c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:47.279242 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4bb2c157-9448-4468-8f11-444537d3b95c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:47.279945 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4bb2c157-9448-4468-8f11-444537d3b95c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:47.282015 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4bb2c157-9448-4468-8f11-444537d3b95c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:47.282562 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4bb2c157-9448-4468-8f11-444537d3b95c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:47.284774 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7f1c1d9a-1295-49f5-a374-068592eeb84b tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da5618e5a5640c28593881e6d144469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd5f2d3f10452aa7848bc1d229dfdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:47.294807 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7f1c1d9a-1295-49f5-a374-068592eeb84b tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "GET /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74" status: 200 len: 1515 microversion: 2.1 time: 0.268487 Feb 19 02:30:47.295762 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 314/657] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:30:47 2021] GET /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74 => generated 1515 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:30:47.524047 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-4bb2c157-9448-4468-8f11-444537d3b95c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:47.533569 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-4bb2c157-9448-4468-8f11-444537d3b95c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:47.535342 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-4bb2c157-9448-4468-8f11-444537d3b95c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:47.536564 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-4bb2c157-9448-4468-8f11-444537d3b95c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1598 microversion: 2.20 time: 0.296863 Feb 19 02:30:47.537165 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 344/658] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:30:47 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1598 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 02:30:47.556082 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-71bd7ac7-7a4d-46a5-9ad0-e0798195b221 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:47.556629 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-71bd7ac7-7a4d-46a5-9ad0-e0798195b221 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:47.564723 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-71bd7ac7-7a4d-46a5-9ad0-e0798195b221 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:47.565441 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-71bd7ac7-7a4d-46a5-9ad0-e0798195b221 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:47.566330 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-71bd7ac7-7a4d-46a5-9ad0-e0798195b221 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:47.566853 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-71bd7ac7-7a4d-46a5-9ad0-e0798195b221 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:47.737040 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-71bd7ac7-7a4d-46a5-9ad0-e0798195b221 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.185446 Feb 19 02:30:47.737981 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 315/659] 10.222.0.44 () {60 vars in 1306 bytes} [Fri Feb 19 02:30:47 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/os-interface => generated 285 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:30:48.029253 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7021cb97-b791-44b6-8e56-67c6f0ec90f1 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:48.030582 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7021cb97-b791-44b6-8e56-67c6f0ec90f1 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:48.040804 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7021cb97-b791-44b6-8e56-67c6f0ec90f1 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:48.041313 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7021cb97-b791-44b6-8e56-67c6f0ec90f1 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:48.042176 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7021cb97-b791-44b6-8e56-67c6f0ec90f1 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:48.042702 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7021cb97-b791-44b6-8e56-67c6f0ec90f1 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:48.314950 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f83483ea-c5b6-49f6-96fe-d94dc36c4e7d tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:48.315616 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f83483ea-c5b6-49f6-96fe-d94dc36c4e7d tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2e279104-c2ca-4bf4-872c-2804655e5a74] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:48.324127 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f83483ea-c5b6-49f6-96fe-d94dc36c4e7d tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:48.324871 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f83483ea-c5b6-49f6-96fe-d94dc36c4e7d tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:48.325929 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f83483ea-c5b6-49f6-96fe-d94dc36c4e7d tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:48.326720 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f83483ea-c5b6-49f6-96fe-d94dc36c4e7d tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:48.508710 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7021cb97-b791-44b6-8e56-67c6f0ec90f1 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:48.524696 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7021cb97-b791-44b6-8e56-67c6f0ec90f1 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1264 microversion: 2.1 time: 0.498989 Feb 19 02:30:48.539557 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 345/660] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:30:48 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1264 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:30:48.732940 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f83483ea-c5b6-49f6-96fe-d94dc36c4e7d tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da5618e5a5640c28593881e6d144469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd5f2d3f10452aa7848bc1d229dfdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:48.743977 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f83483ea-c5b6-49f6-96fe-d94dc36c4e7d tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "GET /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74" status: 200 len: 1515 microversion: 2.1 time: 0.433219 Feb 19 02:30:48.744732 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 316/661] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:30:48 2021] GET /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74 => generated 1515 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:30:49.546742 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-55806d5d-0d98-4305-a58b-7e4c8a2fae25 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:49.547925 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-55806d5d-0d98-4305-a58b-7e4c8a2fae25 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:49.556540 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-55806d5d-0d98-4305-a58b-7e4c8a2fae25 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:49.557211 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-55806d5d-0d98-4305-a58b-7e4c8a2fae25 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:49.558220 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-55806d5d-0d98-4305-a58b-7e4c8a2fae25 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:49.558889 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-55806d5d-0d98-4305-a58b-7e4c8a2fae25 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:49.763093 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-fcaa05f0-f313-4640-bc1e-ab45f3a262bc tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:49.764059 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-fcaa05f0-f313-4640-bc1e-ab45f3a262bc tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2e279104-c2ca-4bf4-872c-2804655e5a74] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:49.779313 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fcaa05f0-f313-4640-bc1e-ab45f3a262bc tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:49.781877 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fcaa05f0-f313-4640-bc1e-ab45f3a262bc tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:49.784509 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fcaa05f0-f313-4640-bc1e-ab45f3a262bc tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:49.785751 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fcaa05f0-f313-4640-bc1e-ab45f3a262bc tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:50.055201 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-55806d5d-0d98-4305-a58b-7e4c8a2fae25 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:50.065865 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-55806d5d-0d98-4305-a58b-7e4c8a2fae25 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1448 microversion: 2.1 time: 0.522489 Feb 19 02:30:50.067076 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 346/662] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:30:49 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1448 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:30:50.072574 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-239d947f-0906-4872-b94d-2ce8add02dad tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:30:50.073894 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-239d947f-0906-4872-b94d-2ce8add02dad tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:50.082942 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-239d947f-0906-4872-b94d-2ce8add02dad tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:50.083567 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-239d947f-0906-4872-b94d-2ce8add02dad tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:50.084661 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-239d947f-0906-4872-b94d-2ce8add02dad tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:50.085373 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-239d947f-0906-4872-b94d-2ce8add02dad tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:50.203614 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-239d947f-0906-4872-b94d-2ce8add02dad tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 14 microversion: 2.20 time: 0.134831 Feb 19 02:30:50.209557 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 347/663] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:30:50 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:30:50.219456 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-d2ccaf2d-7cc2-45fd-b5c8-1aa140477c35 req-387b6fbe-13b7-48c5-b1eb-d252b9d40da7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb5c58f3-abb6-4bda-8928-db72606dcefd", "tag": "c6e75aba-17c0-47ae-b251-61c34117a52a"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:30:50.222278 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:30:50.222278 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:30:50.238293 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-d2ccaf2d-7cc2-45fd-b5c8-1aa140477c35 req-387b6fbe-13b7-48c5-b1eb-d252b9d40da7 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:50.239691 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-d2ccaf2d-7cc2-45fd-b5c8-1aa140477c35 req-387b6fbe-13b7-48c5-b1eb-d252b9d40da7 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:50.265480 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-d2ccaf2d-7cc2-45fd-b5c8-1aa140477c35 req-387b6fbe-13b7-48c5-b1eb-d252b9d40da7 service nova] Creating event network-changed:c6e75aba-17c0-47ae-b251-61c34117a52a for instance eb5c58f3-abb6-4bda-8928-db72606dcefd on hv-cinder-77642 Feb 19 02:30:50.271088 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-d2ccaf2d-7cc2-45fd-b5c8-1aa140477c35 req-387b6fbe-13b7-48c5-b1eb-d252b9d40da7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062828 Feb 19 02:30:50.272669 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 348/664] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:30:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:30:50.279267 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f5ac728d-f57b-48df-8a93-a7936243fb59 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:50.280132 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f5ac728d-f57b-48df-8a93-a7936243fb59 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:50.299737 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f5ac728d-f57b-48df-8a93-a7936243fb59 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:50.300277 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f5ac728d-f57b-48df-8a93-a7936243fb59 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:50.301228 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f5ac728d-f57b-48df-8a93-a7936243fb59 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:50.301798 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f5ac728d-f57b-48df-8a93-a7936243fb59 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:50.558274 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f5ac728d-f57b-48df-8a93-a7936243fb59 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:50.568608 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f5ac728d-f57b-48df-8a93-a7936243fb59 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1448 microversion: 2.1 time: 0.294433 Feb 19 02:30:50.569138 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 349/665] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:30:50 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1448 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:30:50.587661 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5c2c0cf3-f133-421a-a936-1f423f18d50c tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Action: 'create', calling method: .version_select at 0x7f217c2f2598>, body: {"pool": null} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:30:50.659651 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-fcaa05f0-f313-4640-bc1e-ab45f3a262bc tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da5618e5a5640c28593881e6d144469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd5f2d3f10452aa7848bc1d229dfdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:30:50.679605 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-fcaa05f0-f313-4640-bc1e-ab45f3a262bc tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "GET /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74" status: 200 len: 1515 microversion: 2.1 time: 0.920390 Feb 19 02:30:50.680228 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 317/666] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:30:49 2021] GET /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74 => generated 1515 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:30:50.781952 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-166003ac-4193-44e0-9820-21c5667350ab req-d70f9e23-2ce0-47e4-9c6d-af3f2496207e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e279104-c2ca-4bf4-872c-2804655e5a74", "name": "network-vif-deleted", "tag": "3c8c8966-a8f7-40ab-8c5e-69bd76842ed3"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:30:50.783974 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:30:50.783974 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:30:50.794262 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-166003ac-4193-44e0-9820-21c5667350ab req-d70f9e23-2ce0-47e4-9c6d-af3f2496207e service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:50.795048 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-166003ac-4193-44e0-9820-21c5667350ab req-d70f9e23-2ce0-47e4-9c6d-af3f2496207e service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:50.822692 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-166003ac-4193-44e0-9820-21c5667350ab req-d70f9e23-2ce0-47e4-9c6d-af3f2496207e service nova] Creating event network-vif-deleted:3c8c8966-a8f7-40ab-8c5e-69bd76842ed3 for instance 2e279104-c2ca-4bf4-872c-2804655e5a74 on hv-cinder-77642 Feb 19 02:30:50.831463 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-166003ac-4193-44e0-9820-21c5667350ab req-d70f9e23-2ce0-47e4-9c6d-af3f2496207e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053633 Feb 19 02:30:50.832244 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 318/667] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:30:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:30:51.219310 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-84bc9c2b-a736-4f38-b319-bfe70ce5239d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:30:51.220510 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-84bc9c2b-a736-4f38-b319-bfe70ce5239d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:51.229535 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-84bc9c2b-a736-4f38-b319-bfe70ce5239d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:51.230058 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-84bc9c2b-a736-4f38-b319-bfe70ce5239d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:51.231220 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-84bc9c2b-a736-4f38-b319-bfe70ce5239d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:51.231900 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-84bc9c2b-a736-4f38-b319-bfe70ce5239d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:51.334801 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-84bc9c2b-a736-4f38-b319-bfe70ce5239d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 14 microversion: 2.20 time: 0.120260 Feb 19 02:30:51.335878 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 319/668] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:30:51 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:30:51.698262 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1a352d1f-99e6-416f-a8fa-7c6815113447 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:30:51.699175 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1a352d1f-99e6-416f-a8fa-7c6815113447 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2e279104-c2ca-4bf4-872c-2804655e5a74] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:51.708298 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1a352d1f-99e6-416f-a8fa-7c6815113447 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:51.709132 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1a352d1f-99e6-416f-a8fa-7c6815113447 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:51.710068 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1a352d1f-99e6-416f-a8fa-7c6815113447 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:51.712956 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1a352d1f-99e6-416f-a8fa-7c6815113447 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:51.770873 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-1a352d1f-99e6-416f-a8fa-7c6815113447 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] HTTP exception thrown: Instance 2e279104-c2ca-4bf4-872c-2804655e5a74 could not be found. Feb 19 02:30:51.771857 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1a352d1f-99e6-416f-a8fa-7c6815113447 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Returning 404 to user: Instance 2e279104-c2ca-4bf4-872c-2804655e5a74 could not be found. {{(pid=98194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:30:51.773116 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1a352d1f-99e6-416f-a8fa-7c6815113447 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "GET /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74" status: 404 len: 111 microversion: 2.1 time: 0.079364 Feb 19 02:30:51.773906 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 320/669] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:30:51 2021] GET /compute/v2.1/servers/2e279104-c2ca-4bf4-872c-2804655e5a74 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 02:30:52.347327 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5130acae-3d68-406c-8ede-a7297a627c93 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:30:52.348573 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5130acae-3d68-406c-8ede-a7297a627c93 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:52.357662 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5130acae-3d68-406c-8ede-a7297a627c93 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:52.358213 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5130acae-3d68-406c-8ede-a7297a627c93 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:52.362444 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5130acae-3d68-406c-8ede-a7297a627c93 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:52.363102 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5130acae-3d68-406c-8ede-a7297a627c93 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:53.186315 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5c2c0cf3-f133-421a-a936-1f423f18d50c tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 2.603010 Feb 19 02:30:53.187012 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 350/670] 10.222.0.44 () {60 vars in 1160 bytes} [Fri Feb 19 02:30:50 2021] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 2604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:30:53.199023 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1513fe11-4916-4d87-bc80-9f8d161f8737 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Action: 'action', calling method: .version_select at 0x7f217e37d950>, body: {"addFloatingIp": {"address": "172.27.1.6"}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:30:53.200503 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1513fe11-4916-4d87-bc80-9f8d161f8737 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:53.224382 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1513fe11-4916-4d87-bc80-9f8d161f8737 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:53.224898 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1513fe11-4916-4d87-bc80-9f8d161f8737 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:53.225746 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1513fe11-4916-4d87-bc80-9f8d161f8737 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:53.226237 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1513fe11-4916-4d87-bc80-9f8d161f8737 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:53.291885 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1513fe11-4916-4d87-bc80-9f8d161f8737 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Acquired lock "refresh_cache-900317e8-8e9d-49e0-927b-a4d30c204f2c" {{(pid=98193) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 19 02:30:55.283503 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-1513fe11-4916-4d87-bc80-9f8d161f8737 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Building network info cache for instance {{(pid=98193) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 19 02:30:55.399777 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5130acae-3d68-406c-8ede-a7297a627c93 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 14 microversion: 2.20 time: 3.056714 Feb 19 02:30:55.401297 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 321/671] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:30:52 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 14 bytes in 3059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:30:55.417672 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-e4e55a00-44b0-4e94-8b7b-abb8812b9c8e req-074ae12c-7d89-46e4-b482-10c6436d5a86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "900317e8-8e9d-49e0-927b-a4d30c204f2c", "tag": "9b55214e-d4a5-4d7f-a090-48b12fdd6991"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:30:55.426084 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:30:55.426084 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:30:55.453555 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-e4e55a00-44b0-4e94-8b7b-abb8812b9c8e req-074ae12c-7d89-46e4-b482-10c6436d5a86 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:55.454179 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-e4e55a00-44b0-4e94-8b7b-abb8812b9c8e req-074ae12c-7d89-46e4-b482-10c6436d5a86 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:55.475141 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-e4e55a00-44b0-4e94-8b7b-abb8812b9c8e req-074ae12c-7d89-46e4-b482-10c6436d5a86 service nova] Creating event network-changed:9b55214e-d4a5-4d7f-a090-48b12fdd6991 for instance 900317e8-8e9d-49e0-927b-a4d30c204f2c on hv-cinder-77642 Feb 19 02:30:55.480517 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-e4e55a00-44b0-4e94-8b7b-abb8812b9c8e req-074ae12c-7d89-46e4-b482-10c6436d5a86 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077358 Feb 19 02:30:55.481455 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 322/672] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:30:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:30:56.170831 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-1513fe11-4916-4d87-bc80-9f8d161f8737 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Updating instance_info_cache with network_info: [{"id": "9b55214e-d4a5-4d7f-a090-48b12fdd6991", "address": "fa:16:3e:74:f5:e0", "network": {"id": "1a196cc5-5370-49d8-b297-9862ae510cb8", "bridge": "br-int", "label": "tempest-TestShelveInstance-336767559-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.1.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e134d1a72aee466e8636d06121d39c09", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap9b55214e-d4", "ovs_interfaceid": "9b55214e-d4a5-4d7f-a090-48b12fdd6991", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98193) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 19 02:30:56.183725 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1513fe11-4916-4d87-bc80-9f8d161f8737 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Releasing lock "refresh_cache-900317e8-8e9d-49e0-927b-a4d30c204f2c" {{(pid=98193) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 19 02:30:56.184944 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1513fe11-4916-4d87-bc80-9f8d161f8737 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "POST /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c/action" status: 202 len: 0 microversion: 2.1 time: 2.989857 Feb 19 02:30:56.185825 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 351/673] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:30:53 2021] POST /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c/action => generated 0 bytes in 2992 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 19 02:30:56.413028 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1f3efbdf-fc71-4d38-b6e7-8519f1b34b2a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:30:56.414343 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1f3efbdf-fc71-4d38-b6e7-8519f1b34b2a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:56.422590 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1f3efbdf-fc71-4d38-b6e7-8519f1b34b2a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:56.423098 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1f3efbdf-fc71-4d38-b6e7-8519f1b34b2a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:56.423972 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1f3efbdf-fc71-4d38-b6e7-8519f1b34b2a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:56.424513 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1f3efbdf-fc71-4d38-b6e7-8519f1b34b2a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:56.528797 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1f3efbdf-fc71-4d38-b6e7-8519f1b34b2a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 14 microversion: 2.20 time: 0.120466 Feb 19 02:30:56.530574 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 323/674] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:30:56 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:30:57.541797 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-85e96faf-4713-4d0b-ae2f-0ebd9657267f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:30:57.542983 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-85e96faf-4713-4d0b-ae2f-0ebd9657267f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:57.552191 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-85e96faf-4713-4d0b-ae2f-0ebd9657267f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:57.552699 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-85e96faf-4713-4d0b-ae2f-0ebd9657267f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:57.554165 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-85e96faf-4713-4d0b-ae2f-0ebd9657267f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:57.554704 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-85e96faf-4713-4d0b-ae2f-0ebd9657267f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:57.654617 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-85e96faf-4713-4d0b-ae2f-0ebd9657267f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 14 microversion: 2.20 time: 0.117145 Feb 19 02:30:57.667019 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 352/675] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:30:57 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:30:58.675003 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-40abb759-4219-4aee-b078-cf9f070918f4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:30:58.676135 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-40abb759-4219-4aee-b078-cf9f070918f4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:30:58.685755 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-40abb759-4219-4aee-b078-cf9f070918f4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:58.686256 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-40abb759-4219-4aee-b078-cf9f070918f4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:30:58.687101 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-40abb759-4219-4aee-b078-cf9f070918f4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:30:58.687586 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-40abb759-4219-4aee-b078-cf9f070918f4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:00.812740 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-40abb759-4219-4aee-b078-cf9f070918f4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 14 microversion: 2.20 time: 2.142277 Feb 19 02:31:00.813607 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 324/676] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:30:58 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 14 bytes in 2144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:31:01.242906 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-02c97f32-2149-42d1-a1a2-6905ee30cae4 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-889342811", "imageRef": "37a0f9d8-d3f7-417e-bce6-371e41a47c88", "flavorRef": "452", "networks": [{"uuid": "d734f7f3-2e72-4bf5-8705-7f9359473827"}]}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:01.484309 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-02c97f32-2149-42d1-a1a2-6905ee30cae4 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] validate_networks() for [('d734f7f3-2e72-4bf5-8705-7f9359473827', None, None, None)] {{(pid=98193) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 02:31:01.826905 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4fac78ae-4e80-4494-973d-7d87c24a219d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:01.828074 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-4fac78ae-4e80-4494-973d-7d87c24a219d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:01.837094 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4fac78ae-4e80-4494-973d-7d87c24a219d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:01.837669 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4fac78ae-4e80-4494-973d-7d87c24a219d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:01.838571 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4fac78ae-4e80-4494-973d-7d87c24a219d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:01.839075 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4fac78ae-4e80-4494-973d-7d87c24a219d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:02.236617 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-02c97f32-2149-42d1-a1a2-6905ee30cae4 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Flavor limits 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 02:31:02.237100 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-02c97f32-2149-42d1-a1a2-6905ee30cae4 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Image limits 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 02:31:02.237649 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-02c97f32-2149-42d1-a1a2-6905ee30cae4 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Flavor pref 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 02:31:02.238156 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-02c97f32-2149-42d1-a1a2-6905ee30cae4 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Image pref 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 02:31:02.238679 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-02c97f32-2149-42d1-a1a2-6905ee30cae4 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 02:31:02.248341 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-02c97f32-2149-42d1-a1a2-6905ee30cae4 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:02.248858 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-02c97f32-2149-42d1-a1a2-6905ee30cae4 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:02.249742 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-02c97f32-2149-42d1-a1a2-6905ee30cae4 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:02.250241 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-02c97f32-2149-42d1-a1a2-6905ee30cae4 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:02.268962 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-02c97f32-2149-42d1-a1a2-6905ee30cae4 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Getting quotas for project 34bd5f2d3f10452aa7848bc1d229dfdd. Resources: {'ram', 'instances', 'cores'} {{(pid=98193) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:31:02.273236 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-02c97f32-2149-42d1-a1a2-6905ee30cae4 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Getting quotas for user 5da5618e5a5640c28593881e6d144469 and project 34bd5f2d3f10452aa7848bc1d229dfdd. Resources: {'ram', 'instances', 'cores'} {{(pid=98193) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:31:02.284299 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-02c97f32-2149-42d1-a1a2-6905ee30cae4 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Going to run 1 instances... {{(pid=98193) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 02:31:02.287569 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-02c97f32-2149-42d1-a1a2-6905ee30cae4 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2f547266-6472-46d2-a651-03a6dab0b871] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37a0f9d8-d3f7-417e-bce6-371e41a47c88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 02:31:02.336591 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-02c97f32-2149-42d1-a1a2-6905ee30cae4 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.098265 Feb 19 02:31:02.337297 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 353/677] 10.222.0.44 () {60 vars in 1137 bytes} [Fri Feb 19 02:31:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 1100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 02:31:02.347791 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-05dfcf14-2489-4723-bbeb-0ef823a22118 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:02.348462 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-05dfcf14-2489-4723-bbeb-0ef823a22118 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2f547266-6472-46d2-a651-03a6dab0b871] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:02.426195 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-05dfcf14-2489-4723-bbeb-0ef823a22118 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da5618e5a5640c28593881e6d144469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd5f2d3f10452aa7848bc1d229dfdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:02.435117 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-05dfcf14-2489-4723-bbeb-0ef823a22118 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871" status: 200 len: 1218 microversion: 2.1 time: 0.091114 Feb 19 02:31:02.435731 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 354/678] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:02 2021] GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:31:03.453516 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a610c732-de2d-4b36-b414-13c55064d5f4 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:03.454183 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a610c732-de2d-4b36-b414-13c55064d5f4 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2f547266-6472-46d2-a651-03a6dab0b871] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:03.462840 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a610c732-de2d-4b36-b414-13c55064d5f4 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:03.463342 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a610c732-de2d-4b36-b414-13c55064d5f4 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:03.464171 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a610c732-de2d-4b36-b414-13c55064d5f4 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:03.464653 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a610c732-de2d-4b36-b414-13c55064d5f4 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:03.591771 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a610c732-de2d-4b36-b414-13c55064d5f4 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da5618e5a5640c28593881e6d144469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd5f2d3f10452aa7848bc1d229dfdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:03.601118 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a610c732-de2d-4b36-b414-13c55064d5f4 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871" status: 200 len: 1222 microversion: 2.1 time: 0.151841 Feb 19 02:31:03.601735 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 355/679] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:03 2021] GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871 => generated 1222 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:31:03.606382 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-9305c9c3-7146-49e4-960a-9430b3b577fa tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:03.606922 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-9305c9c3-7146-49e4-960a-9430b3b577fa tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:03.614136 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9305c9c3-7146-49e4-960a-9430b3b577fa tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:03.614686 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9305c9c3-7146-49e4-960a-9430b3b577fa tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:03.616190 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9305c9c3-7146-49e4-960a-9430b3b577fa tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:03.616677 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9305c9c3-7146-49e4-960a-9430b3b577fa tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:03.681391 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-9305c9c3-7146-49e4-960a-9430b3b577fa tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Going to try to terminate instance {{(pid=98193) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 02:31:03.801191 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-9305c9c3-7146-49e4-960a-9430b3b577fa tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "DELETE /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 204 len: 0 microversion: 2.1 time: 0.198098 Feb 19 02:31:03.802008 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 356/680] 10.222.0.44 () {58 vars in 1229 bytes} [Fri Feb 19 02:31:03 2021] DELETE /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 02:31:03.811810 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-532adde5-64f7-41e7-ad0d-05c82b6ca78f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:03.812579 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-532adde5-64f7-41e7-ad0d-05c82b6ca78f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:03.820313 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-532adde5-64f7-41e7-ad0d-05c82b6ca78f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:03.820828 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-532adde5-64f7-41e7-ad0d-05c82b6ca78f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:03.821669 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-532adde5-64f7-41e7-ad0d-05c82b6ca78f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:03.822165 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-532adde5-64f7-41e7-ad0d-05c82b6ca78f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:04.031966 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-532adde5-64f7-41e7-ad0d-05c82b6ca78f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:04.040958 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-532adde5-64f7-41e7-ad0d-05c82b6ca78f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1671 microversion: 2.1 time: 0.233725 Feb 19 02:31:04.041583 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 357/681] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:03 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1671 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:31:04.078745 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-4fac78ae-4e80-4494-973d-7d87c24a219d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 15025 microversion: 2.20 time: 2.256585 Feb 19 02:31:04.079482 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 325/682] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:01 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 15025 bytes in 2259 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 19 02:31:04.620337 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-6cf8a018-1c27-47c7-b7cc-df01e9b57505 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:04.621000 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-6cf8a018-1c27-47c7-b7cc-df01e9b57505 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2f547266-6472-46d2-a651-03a6dab0b871] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:04.629275 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6cf8a018-1c27-47c7-b7cc-df01e9b57505 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:04.629774 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6cf8a018-1c27-47c7-b7cc-df01e9b57505 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:04.630626 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6cf8a018-1c27-47c7-b7cc-df01e9b57505 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:04.631111 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6cf8a018-1c27-47c7-b7cc-df01e9b57505 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:04.755583 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-6cf8a018-1c27-47c7-b7cc-df01e9b57505 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da5618e5a5640c28593881e6d144469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd5f2d3f10452aa7848bc1d229dfdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:04.764584 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-6cf8a018-1c27-47c7-b7cc-df01e9b57505 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871" status: 200 len: 1270 microversion: 2.1 time: 0.148322 Feb 19 02:31:04.766544 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 358/683] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:04 2021] GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871 => generated 1270 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:31:05.061881 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a1c65016-7adb-457d-b0ee-cc389a031a6e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:05.062455 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a1c65016-7adb-457d-b0ee-cc389a031a6e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:05.075857 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a1c65016-7adb-457d-b0ee-cc389a031a6e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:05.076873 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a1c65016-7adb-457d-b0ee-cc389a031a6e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:05.078199 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a1c65016-7adb-457d-b0ee-cc389a031a6e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:05.078866 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a1c65016-7adb-457d-b0ee-cc389a031a6e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:05.093652 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a99b9780-8634-4380-8e6e-74446282e51c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:05.096208 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a99b9780-8634-4380-8e6e-74446282e51c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:05.116063 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a99b9780-8634-4380-8e6e-74446282e51c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:05.116575 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a99b9780-8634-4380-8e6e-74446282e51c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:05.119672 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a99b9780-8634-4380-8e6e-74446282e51c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:05.121033 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a99b9780-8634-4380-8e6e-74446282e51c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:05.321599 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a99b9780-8634-4380-8e6e-74446282e51c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 17808 microversion: 2.20 time: 0.234379 Feb 19 02:31:05.322608 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 359/684] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:05 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 17808 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 19 02:31:05.706781 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a1c65016-7adb-457d-b0ee-cc389a031a6e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:05.716793 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a1c65016-7adb-457d-b0ee-cc389a031a6e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1671 microversion: 2.1 time: 0.659894 Feb 19 02:31:05.717374 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 326/685] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:05 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1671 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:31:05.785119 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-846569b0-740e-4923-9c81-cbc4096e3ce6 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:05.785939 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-846569b0-740e-4923-9c81-cbc4096e3ce6 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2f547266-6472-46d2-a651-03a6dab0b871] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:05.795426 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-846569b0-740e-4923-9c81-cbc4096e3ce6 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:05.795934 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-846569b0-740e-4923-9c81-cbc4096e3ce6 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:05.796814 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-846569b0-740e-4923-9c81-cbc4096e3ce6 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:05.797302 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-846569b0-740e-4923-9c81-cbc4096e3ce6 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:05.923832 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-846569b0-740e-4923-9c81-cbc4096e3ce6 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da5618e5a5640c28593881e6d144469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd5f2d3f10452aa7848bc1d229dfdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:05.933523 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-846569b0-740e-4923-9c81-cbc4096e3ce6 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871" status: 200 len: 1276 microversion: 2.1 time: 0.153306 Feb 19 02:31:05.934402 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 360/686] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:05 2021] GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871 => generated 1276 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:31:06.335198 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b9ed77c0-3b71-4a4e-b763-6174d5fe2e08 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:06.336300 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b9ed77c0-3b71-4a4e-b763-6174d5fe2e08 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:06.345656 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b9ed77c0-3b71-4a4e-b763-6174d5fe2e08 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:06.346406 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b9ed77c0-3b71-4a4e-b763-6174d5fe2e08 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:06.347279 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b9ed77c0-3b71-4a4e-b763-6174d5fe2e08 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:06.347805 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b9ed77c0-3b71-4a4e-b763-6174d5fe2e08 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:06.470319 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b9ed77c0-3b71-4a4e-b763-6174d5fe2e08 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 17861 microversion: 2.20 time: 0.139654 Feb 19 02:31:06.471355 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 327/687] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:06 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 17861 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:31:06.736653 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e1360987-11c3-40dd-a4c9-daa1c83b577c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:06.737894 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e1360987-11c3-40dd-a4c9-daa1c83b577c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:06.747998 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e1360987-11c3-40dd-a4c9-daa1c83b577c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:06.748757 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e1360987-11c3-40dd-a4c9-daa1c83b577c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:06.750035 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e1360987-11c3-40dd-a4c9-daa1c83b577c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:06.750902 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e1360987-11c3-40dd-a4c9-daa1c83b577c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:06.952893 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e6e8c158-ef07-43e4-9b0c-048e618c245a tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:06.954222 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e6e8c158-ef07-43e4-9b0c-048e618c245a tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2f547266-6472-46d2-a651-03a6dab0b871] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:06.980627 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e6e8c158-ef07-43e4-9b0c-048e618c245a tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:06.981346 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e6e8c158-ef07-43e4-9b0c-048e618c245a tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:06.983404 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e6e8c158-ef07-43e4-9b0c-048e618c245a tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:06.990769 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e6e8c158-ef07-43e4-9b0c-048e618c245a tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:07.183757 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e1360987-11c3-40dd-a4c9-daa1c83b577c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:07.197684 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e1360987-11c3-40dd-a4c9-daa1c83b577c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1671 microversion: 2.1 time: 0.465616 Feb 19 02:31:07.198303 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 361/688] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:06 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1671 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:31:07.249989 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-dc450576-220b-419b-ab97-97f6722778e6 req-1311906a-a4c2-4d4b-aa6b-855f5e81e587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42f746d8-04b6-4db3-a823-ecff5e8dab6b", "name": "network-vif-unplugged", "status": "completed", "tag": "d5caccc3-33c1-47a3-b424-89ffc91a1700"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:07.267333 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:31:07.267333 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:31:07.293272 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-dc450576-220b-419b-ab97-97f6722778e6 req-1311906a-a4c2-4d4b-aa6b-855f5e81e587 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:07.293763 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-dc450576-220b-419b-ab97-97f6722778e6 req-1311906a-a4c2-4d4b-aa6b-855f5e81e587 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:07.335953 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-dc450576-220b-419b-ab97-97f6722778e6 req-1311906a-a4c2-4d4b-aa6b-855f5e81e587 service nova] Creating event network-vif-unplugged:d5caccc3-33c1-47a3-b424-89ffc91a1700 for instance 42f746d8-04b6-4db3-a823-ecff5e8dab6b on hv-cinder-77642 Feb 19 02:31:07.343570 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-dc450576-220b-419b-ab97-97f6722778e6 req-1311906a-a4c2-4d4b-aa6b-855f5e81e587 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097332 Feb 19 02:31:07.346666 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 362/689] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:31:07 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:31:07.486657 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-080536a8-0923-4fc6-b4b7-9a4906eba848 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:07.488093 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-080536a8-0923-4fc6-b4b7-9a4906eba848 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:07.498657 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-080536a8-0923-4fc6-b4b7-9a4906eba848 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:07.499176 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-080536a8-0923-4fc6-b4b7-9a4906eba848 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:07.500303 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-080536a8-0923-4fc6-b4b7-9a4906eba848 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:07.500782 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-080536a8-0923-4fc6-b4b7-9a4906eba848 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:07.626818 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-080536a8-0923-4fc6-b4b7-9a4906eba848 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 20997 microversion: 2.20 time: 0.146132 Feb 19 02:31:07.631171 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 363/690] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:07 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 20997 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:31:07.814138 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e6e8c158-ef07-43e4-9b0c-048e618c245a tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da5618e5a5640c28593881e6d144469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd5f2d3f10452aa7848bc1d229dfdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:07.824822 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e6e8c158-ef07-43e4-9b0c-048e618c245a tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871" status: 200 len: 1318 microversion: 2.1 time: 0.876484 Feb 19 02:31:07.825500 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 328/691] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:06 2021] GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871 => generated 1318 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:31:08.217470 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c2693d82-9ba2-4ad2-b6aa-7026e1aa2a3b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:08.218556 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c2693d82-9ba2-4ad2-b6aa-7026e1aa2a3b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:08.228345 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c2693d82-9ba2-4ad2-b6aa-7026e1aa2a3b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:08.229004 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c2693d82-9ba2-4ad2-b6aa-7026e1aa2a3b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:08.230783 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c2693d82-9ba2-4ad2-b6aa-7026e1aa2a3b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:08.231577 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c2693d82-9ba2-4ad2-b6aa-7026e1aa2a3b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:08.642649 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-726a87bc-ebce-4470-ac17-fc468c35f9d8 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:08.644142 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-726a87bc-ebce-4470-ac17-fc468c35f9d8 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:08.657165 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-726a87bc-ebce-4470-ac17-fc468c35f9d8 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:08.657891 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-726a87bc-ebce-4470-ac17-fc468c35f9d8 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:08.658902 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-726a87bc-ebce-4470-ac17-fc468c35f9d8 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:08.659847 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-726a87bc-ebce-4470-ac17-fc468c35f9d8 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:08.677148 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c2693d82-9ba2-4ad2-b6aa-7026e1aa2a3b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:08.700423 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c2693d82-9ba2-4ad2-b6aa-7026e1aa2a3b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1671 microversion: 2.1 time: 0.487282 Feb 19 02:31:08.701512 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 364/692] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:08 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1671 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:31:08.741568 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-b3cf82d0-8e63-48e1-9be6-1540cbc3ad14 req-2c54d7f7-16b8-4ecb-8900-b3b4888f4161 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f547266-6472-46d2-a651-03a6dab0b871", "tag": "d1b61b95-00d7-4d6d-b713-66c941346701"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:08.743834 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:31:08.743834 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:31:08.759620 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-b3cf82d0-8e63-48e1-9be6-1540cbc3ad14 req-2c54d7f7-16b8-4ecb-8900-b3b4888f4161 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:08.760113 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-b3cf82d0-8e63-48e1-9be6-1540cbc3ad14 req-2c54d7f7-16b8-4ecb-8900-b3b4888f4161 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:08.780623 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-b3cf82d0-8e63-48e1-9be6-1540cbc3ad14 req-2c54d7f7-16b8-4ecb-8900-b3b4888f4161 service nova] Creating event network-changed:d1b61b95-00d7-4d6d-b713-66c941346701 for instance 2f547266-6472-46d2-a651-03a6dab0b871 on hv-cinder-77642 Feb 19 02:31:08.785727 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-b3cf82d0-8e63-48e1-9be6-1540cbc3ad14 req-2c54d7f7-16b8-4ecb-8900-b3b4888f4161 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048799 Feb 19 02:31:08.786630 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 365/693] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:31:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:31:08.824001 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-726a87bc-ebce-4470-ac17-fc468c35f9d8 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 22980 microversion: 2.20 time: 0.188819 Feb 19 02:31:08.829128 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 329/694] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:08 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 22980 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 19 02:31:08.844674 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b0272d55-fd7d-42f0-9db0-b36343ebdf80 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:08.845439 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b0272d55-fd7d-42f0-9db0-b36343ebdf80 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2f547266-6472-46d2-a651-03a6dab0b871] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:08.854680 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b0272d55-fd7d-42f0-9db0-b36343ebdf80 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:08.855189 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b0272d55-fd7d-42f0-9db0-b36343ebdf80 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:08.856183 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b0272d55-fd7d-42f0-9db0-b36343ebdf80 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:08.856674 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b0272d55-fd7d-42f0-9db0-b36343ebdf80 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:09.259083 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b0272d55-fd7d-42f0-9db0-b36343ebdf80 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da5618e5a5640c28593881e6d144469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd5f2d3f10452aa7848bc1d229dfdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:09.268474 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b0272d55-fd7d-42f0-9db0-b36343ebdf80 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871" status: 200 len: 1318 microversion: 2.1 time: 0.428773 Feb 19 02:31:09.269541 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 366/695] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:08 2021] GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871 => generated 1318 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:31:09.720689 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-deb904cd-e237-4c61-bb46-571f3dbaf8ab tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:09.721602 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-deb904cd-e237-4c61-bb46-571f3dbaf8ab tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:09.731551 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-deb904cd-e237-4c61-bb46-571f3dbaf8ab tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:09.732079 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-deb904cd-e237-4c61-bb46-571f3dbaf8ab tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:09.733209 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-deb904cd-e237-4c61-bb46-571f3dbaf8ab tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:09.733781 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-deb904cd-e237-4c61-bb46-571f3dbaf8ab tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:09.837583 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-50ced551-27dd-4f3e-abfc-07c335d8feca tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:09.838887 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-50ced551-27dd-4f3e-abfc-07c335d8feca tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:09.857286 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-50ced551-27dd-4f3e-abfc-07c335d8feca tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:09.857807 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-50ced551-27dd-4f3e-abfc-07c335d8feca tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:09.858742 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-50ced551-27dd-4f3e-abfc-07c335d8feca tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:09.859629 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-50ced551-27dd-4f3e-abfc-07c335d8feca tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:09.890673 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-deb904cd-e237-4c61-bb46-571f3dbaf8ab tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:09.922019 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-deb904cd-e237-4c61-bb46-571f3dbaf8ab tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1604 microversion: 2.1 time: 0.205663 Feb 19 02:31:09.923197 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 330/696] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:09 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1604 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:31:10.288394 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ebdb594d-8aec-4eb7-91b1-0715df950bea tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:10.289350 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ebdb594d-8aec-4eb7-91b1-0715df950bea tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2f547266-6472-46d2-a651-03a6dab0b871] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:10.297834 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ebdb594d-8aec-4eb7-91b1-0715df950bea tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:10.301066 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ebdb594d-8aec-4eb7-91b1-0715df950bea tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:10.301066 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ebdb594d-8aec-4eb7-91b1-0715df950bea tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:10.301066 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ebdb594d-8aec-4eb7-91b1-0715df950bea tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:10.522820 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ebdb594d-8aec-4eb7-91b1-0715df950bea tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da5618e5a5640c28593881e6d144469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd5f2d3f10452aa7848bc1d229dfdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:10.533944 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ebdb594d-8aec-4eb7-91b1-0715df950bea tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871" status: 200 len: 1318 microversion: 2.1 time: 0.249983 Feb 19 02:31:10.534782 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 331/697] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:10 2021] GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:31:10.544000 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-29c3f9d3-9c2c-44f5-b4ea-067560332972 req-b0f7c5d0-d625-4631-8fe1-d6a5af06a891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42f746d8-04b6-4db3-a823-ecff5e8dab6b", "name": "network-vif-deleted", "tag": "d5caccc3-33c1-47a3-b424-89ffc91a1700"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:10.547007 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:31:10.547007 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:31:10.561030 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-29c3f9d3-9c2c-44f5-b4ea-067560332972 req-b0f7c5d0-d625-4631-8fe1-d6a5af06a891 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:10.561659 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-29c3f9d3-9c2c-44f5-b4ea-067560332972 req-b0f7c5d0-d625-4631-8fe1-d6a5af06a891 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:10.581985 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-29c3f9d3-9c2c-44f5-b4ea-067560332972 req-b0f7c5d0-d625-4631-8fe1-d6a5af06a891 service nova] Creating event network-vif-deleted:d5caccc3-33c1-47a3-b424-89ffc91a1700 for instance 42f746d8-04b6-4db3-a823-ecff5e8dab6b on hv-cinder-77642 Feb 19 02:31:10.587494 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-29c3f9d3-9c2c-44f5-b4ea-067560332972 req-b0f7c5d0-d625-4631-8fe1-d6a5af06a891 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047842 Feb 19 02:31:10.588377 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 332/698] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:31:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:31:10.944784 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a582bcb3-cb6e-4251-9b40-571b91d61b3a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:10.947479 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a582bcb3-cb6e-4251-9b40-571b91d61b3a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:10.956616 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a582bcb3-cb6e-4251-9b40-571b91d61b3a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:10.957321 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a582bcb3-cb6e-4251-9b40-571b91d61b3a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:10.958382 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a582bcb3-cb6e-4251-9b40-571b91d61b3a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:10.959597 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a582bcb3-cb6e-4251-9b40-571b91d61b3a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:11.117072 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a582bcb3-cb6e-4251-9b40-571b91d61b3a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:11.131845 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a582bcb3-cb6e-4251-9b40-571b91d61b3a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1604 microversion: 2.1 time: 0.193946 Feb 19 02:31:11.132679 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 333/699] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:10 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1604 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:31:11.553518 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5c151845-5027-4ee3-b178-d6d28f61dbe7 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:11.554233 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5c151845-5027-4ee3-b178-d6d28f61dbe7 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2f547266-6472-46d2-a651-03a6dab0b871] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:11.562575 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5c151845-5027-4ee3-b178-d6d28f61dbe7 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:11.563090 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5c151845-5027-4ee3-b178-d6d28f61dbe7 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:11.563944 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5c151845-5027-4ee3-b178-d6d28f61dbe7 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:11.564386 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5c151845-5027-4ee3-b178-d6d28f61dbe7 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:11.809431 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5c151845-5027-4ee3-b178-d6d28f61dbe7 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da5618e5a5640c28593881e6d144469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd5f2d3f10452aa7848bc1d229dfdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:11.820517 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5c151845-5027-4ee3-b178-d6d28f61dbe7 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871" status: 200 len: 1318 microversion: 2.1 time: 0.271330 Feb 19 02:31:11.831318 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 334/700] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:11 2021] GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:31:11.906763 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-50ced551-27dd-4f3e-abfc-07c335d8feca tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 25385 microversion: 2.20 time: 2.073934 Feb 19 02:31:11.908067 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 367/701] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:09 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 25385 bytes in 2076 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:31:12.152085 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-0e1515cf-3978-4b75-9b2a-761789c2c76d tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:12.153369 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-0e1515cf-3978-4b75-9b2a-761789c2c76d tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:12.166554 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0e1515cf-3978-4b75-9b2a-761789c2c76d tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:12.167256 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0e1515cf-3978-4b75-9b2a-761789c2c76d tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:12.168267 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0e1515cf-3978-4b75-9b2a-761789c2c76d tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:12.168936 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0e1515cf-3978-4b75-9b2a-761789c2c76d tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:12.253984 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0e1515cf-3978-4b75-9b2a-761789c2c76d tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:12.254529 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0e1515cf-3978-4b75-9b2a-761789c2c76d tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:12.255050 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.objects.instance [None req-0e1515cf-3978-4b75-9b2a-761789c2c76d tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lazy-loading 'fault' on Instance uuid 42f746d8-04b6-4db3-a823-ecff5e8dab6b {{(pid=98194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 02:31:12.337636 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-0e1515cf-3978-4b75-9b2a-761789c2c76d tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:12.346876 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-0e1515cf-3978-4b75-9b2a-761789c2c76d tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 200 len: 1327 microversion: 2.1 time: 0.198520 Feb 19 02:31:12.347740 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 335/702] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:12 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 1327 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:31:12.839668 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a872e0f2-76e6-4720-8e8f-e01464db7385 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:12.841005 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a872e0f2-76e6-4720-8e8f-e01464db7385 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2f547266-6472-46d2-a651-03a6dab0b871] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:12.850873 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a872e0f2-76e6-4720-8e8f-e01464db7385 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:12.851707 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a872e0f2-76e6-4720-8e8f-e01464db7385 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:12.853524 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a872e0f2-76e6-4720-8e8f-e01464db7385 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:12.854226 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a872e0f2-76e6-4720-8e8f-e01464db7385 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:12.920001 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-da856e3f-35e4-434f-a58c-c0bf90ab70fb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:12.920654 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-da856e3f-35e4-434f-a58c-c0bf90ab70fb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:12.928785 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-da856e3f-35e4-434f-a58c-c0bf90ab70fb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:12.929306 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-da856e3f-35e4-434f-a58c-c0bf90ab70fb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:12.930297 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-da856e3f-35e4-434f-a58c-c0bf90ab70fb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:12.931380 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-da856e3f-35e4-434f-a58c-c0bf90ab70fb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:13.090576 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-da856e3f-35e4-434f-a58c-c0bf90ab70fb tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 26311 microversion: 2.20 time: 0.171610 Feb 19 02:31:13.091762 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 336/703] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:12 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 26311 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:31:13.140175 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a872e0f2-76e6-4720-8e8f-e01464db7385 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da5618e5a5640c28593881e6d144469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd5f2d3f10452aa7848bc1d229dfdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:13.150088 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a872e0f2-76e6-4720-8e8f-e01464db7385 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871" status: 200 len: 1318 microversion: 2.1 time: 0.314642 Feb 19 02:31:13.150778 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 368/704] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:12 2021] GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871 => generated 1318 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:31:13.366972 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-be76fb67-b198-4438-8f86-51675dd64ea7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:13.367744 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-be76fb67-b198-4438-8f86-51675dd64ea7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:13.376290 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-be76fb67-b198-4438-8f86-51675dd64ea7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:13.376800 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-be76fb67-b198-4438-8f86-51675dd64ea7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:13.377629 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-be76fb67-b198-4438-8f86-51675dd64ea7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:13.378124 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-be76fb67-b198-4438-8f86-51675dd64ea7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:13.430775 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-be76fb67-b198-4438-8f86-51675dd64ea7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] HTTP exception thrown: Instance 42f746d8-04b6-4db3-a823-ecff5e8dab6b could not be found. Feb 19 02:31:13.431442 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-be76fb67-b198-4438-8f86-51675dd64ea7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Returning 404 to user: Instance 42f746d8-04b6-4db3-a823-ecff5e8dab6b could not be found. {{(pid=98194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:31:13.432346 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-be76fb67-b198-4438-8f86-51675dd64ea7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 404 len: 111 microversion: 2.1 time: 0.069948 Feb 19 02:31:13.432948 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 337/705] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:13 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 02:31:13.441820 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d2ad68a7-f6e9-48e2-9b22-d4aafb2d57e5 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '.version_select at 0x7f217d766ea0>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:13.459469 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d2ad68a7-f6e9-48e2-9b22-d4aafb2d57e5 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1361507524" status: 202 len: 0 microversion: 2.1 time: 0.020931 Feb 19 02:31:13.460080 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 369/706] 10.222.0.44 () {58 vars in 1211 bytes} [Fri Feb 19 02:31:13 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1361507524 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:31:14.103909 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-2287fd6d-8bf4-4bee-9e0a-9eaed6ad62b1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:14.105114 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-2287fd6d-8bf4-4bee-9e0a-9eaed6ad62b1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:14.113642 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2287fd6d-8bf4-4bee-9e0a-9eaed6ad62b1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:14.114278 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2287fd6d-8bf4-4bee-9e0a-9eaed6ad62b1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:14.115253 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2287fd6d-8bf4-4bee-9e0a-9eaed6ad62b1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:14.115875 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2287fd6d-8bf4-4bee-9e0a-9eaed6ad62b1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:14.169547 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-05940e99-01aa-432d-aa3d-e8e8f79e428e tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:14.182100 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-05940e99-01aa-432d-aa3d-e8e8f79e428e tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2f547266-6472-46d2-a651-03a6dab0b871] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:14.202820 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-05940e99-01aa-432d-aa3d-e8e8f79e428e tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:14.203425 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-05940e99-01aa-432d-aa3d-e8e8f79e428e tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:14.204351 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-05940e99-01aa-432d-aa3d-e8e8f79e428e tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:14.204915 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-05940e99-01aa-432d-aa3d-e8e8f79e428e tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:14.241864 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-2287fd6d-8bf4-4bee-9e0a-9eaed6ad62b1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 27229 microversion: 2.20 time: 0.142286 Feb 19 02:31:14.242589 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 338/707] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:14 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 27229 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:31:14.646912 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-05940e99-01aa-432d-aa3d-e8e8f79e428e tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da5618e5a5640c28593881e6d144469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd5f2d3f10452aa7848bc1d229dfdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:14.660663 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-05940e99-01aa-432d-aa3d-e8e8f79e428e tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871" status: 200 len: 1318 microversion: 2.1 time: 0.495494 Feb 19 02:31:14.661312 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 370/708] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:14 2021] GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871 => generated 1318 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:31:14.789567 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d79a4b0f-4447-4131-99c7-e7999a8da650 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'create', calling method: .version_select at 0x7f21816e6730>, body: {"keypair": {"name": "tempest-keypair-53938536"}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:14.818279 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-194dc54e-bd0c-481d-b68e-36dc872119dc req-4c3f7c3e-1274-4015-a23a-cacc9ecb7095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f547266-6472-46d2-a651-03a6dab0b871", "name": "network-vif-plugged", "status": "completed", "tag": "d1b61b95-00d7-4d6d-b713-66c941346701"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:14.819458 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-d79a4b0f-4447-4131-99c7-e7999a8da650 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Getting quotas for project ce3f0058e9cc413c9235ce9b044f5d1f. Resources: {'key_pairs'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:31:14.820102 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:31:14.820102 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:31:14.824263 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-d79a4b0f-4447-4131-99c7-e7999a8da650 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Getting quotas for user f95ba89e87bd4588a0c6c3593a6a4071 and project ce3f0058e9cc413c9235ce9b044f5d1f. Resources: {'key_pairs'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:31:14.829319 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-194dc54e-bd0c-481d-b68e-36dc872119dc req-4c3f7c3e-1274-4015-a23a-cacc9ecb7095 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:14.829819 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-194dc54e-bd0c-481d-b68e-36dc872119dc req-4c3f7c3e-1274-4015-a23a-cacc9ecb7095 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:14.847380 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-194dc54e-bd0c-481d-b68e-36dc872119dc req-4c3f7c3e-1274-4015-a23a-cacc9ecb7095 service nova] Creating event network-vif-plugged:d1b61b95-00d7-4d6d-b713-66c941346701 for instance 2f547266-6472-46d2-a651-03a6dab0b871 on hv-cinder-77642 Feb 19 02:31:14.852828 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-194dc54e-bd0c-481d-b68e-36dc872119dc req-4c3f7c3e-1274-4015-a23a-cacc9ecb7095 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038620 Feb 19 02:31:14.853667 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 371/709] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:31:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:31:15.090659 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-d79a4b0f-4447-4131-99c7-e7999a8da650 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Getting quotas for project ce3f0058e9cc413c9235ce9b044f5d1f. Resources: {'key_pairs'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:31:15.094734 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-d79a4b0f-4447-4131-99c7-e7999a8da650 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Getting quotas for user f95ba89e87bd4588a0c6c3593a6a4071 and project ce3f0058e9cc413c9235ce9b044f5d1f. Resources: {'key_pairs'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:31:15.108644 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d79a4b0f-4447-4131-99c7-e7999a8da650 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 2299 microversion: 2.1 time: 0.325108 Feb 19 02:31:15.109208 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 339/710] 10.222.0.44 () {60 vars in 1148 bytes} [Fri Feb 19 02:31:14 2021] POST /compute/v2.1/os-keypairs => generated 2299 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:31:15.254319 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5b85d714-55b3-4016-9069-2a857f8cc07a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:15.255704 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5b85d714-55b3-4016-9069-2a857f8cc07a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:15.263889 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5b85d714-55b3-4016-9069-2a857f8cc07a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:15.264398 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5b85d714-55b3-4016-9069-2a857f8cc07a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:15.265271 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5b85d714-55b3-4016-9069-2a857f8cc07a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:15.265755 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5b85d714-55b3-4016-9069-2a857f8cc07a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:15.426299 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5b85d714-55b3-4016-9069-2a857f8cc07a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 27818 microversion: 2.20 time: 0.176188 Feb 19 02:31:15.427104 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 372/711] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:15 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 27818 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:31:15.680673 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d344a0b5-e2b3-4a40-8827-ff94c019e495 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:15.680673 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d344a0b5-e2b3-4a40-8827-ff94c019e495 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2f547266-6472-46d2-a651-03a6dab0b871] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:15.693010 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d344a0b5-e2b3-4a40-8827-ff94c019e495 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:15.694754 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d344a0b5-e2b3-4a40-8827-ff94c019e495 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:15.696197 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d344a0b5-e2b3-4a40-8827-ff94c019e495 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:15.697413 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d344a0b5-e2b3-4a40-8827-ff94c019e495 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:15.936694 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-d344a0b5-e2b3-4a40-8827-ff94c019e495 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da5618e5a5640c28593881e6d144469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd5f2d3f10452aa7848bc1d229dfdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:15.948845 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d344a0b5-e2b3-4a40-8827-ff94c019e495 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871" status: 200 len: 1318 microversion: 2.1 time: 0.273587 Feb 19 02:31:15.949722 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 340/712] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:15 2021] GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871 => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:31:16.441706 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c75f6ab3-519e-462a-923e-ff1ab5fd5ed6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:16.444174 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c75f6ab3-519e-462a-923e-ff1ab5fd5ed6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:16.460697 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c75f6ab3-519e-462a-923e-ff1ab5fd5ed6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:16.470831 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c75f6ab3-519e-462a-923e-ff1ab5fd5ed6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:16.471813 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c75f6ab3-519e-462a-923e-ff1ab5fd5ed6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:16.472315 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c75f6ab3-519e-462a-923e-ff1ab5fd5ed6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:16.605899 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c75f6ab3-519e-462a-923e-ff1ab5fd5ed6 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 28008 microversion: 2.20 time: 0.170355 Feb 19 02:31:16.606697 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 373/713] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:16 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 28008 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:31:16.970134 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-202de038-f79e-4793-85ba-e0e45ac03026 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:16.971604 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-202de038-f79e-4793-85ba-e0e45ac03026 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2f547266-6472-46d2-a651-03a6dab0b871] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:16.990199 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-202de038-f79e-4793-85ba-e0e45ac03026 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:16.991285 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-202de038-f79e-4793-85ba-e0e45ac03026 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:16.992151 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-202de038-f79e-4793-85ba-e0e45ac03026 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:16.992649 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-202de038-f79e-4793-85ba-e0e45ac03026 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:17.224845 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-202de038-f79e-4793-85ba-e0e45ac03026 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da5618e5a5640c28593881e6d144469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd5f2d3f10452aa7848bc1d229dfdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:17.234703 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-202de038-f79e-4793-85ba-e0e45ac03026 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871" status: 200 len: 1507 microversion: 2.1 time: 0.270427 Feb 19 02:31:17.235547 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 341/714] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:16 2021] GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871 => generated 1507 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:31:17.254000 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-57d7b03e-f38a-4ec2-8f9c-b07198328504 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53310f07-a5d1-4b0d-b1c3-1c6b2af0f56f", "device": "/dev/sdb"}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:17.256280 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-57d7b03e-f38a-4ec2-8f9c-b07198328504 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2f547266-6472-46d2-a651-03a6dab0b871] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:17.265803 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-57d7b03e-f38a-4ec2-8f9c-b07198328504 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:17.266666 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-57d7b03e-f38a-4ec2-8f9c-b07198328504 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:17.267680 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-57d7b03e-f38a-4ec2-8f9c-b07198328504 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:17.268380 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-57d7b03e-f38a-4ec2-8f9c-b07198328504 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:17.617661 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-eabc2ba5-bf4e-4e32-a618-2f7508f0c0cd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:17.619071 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-eabc2ba5-bf4e-4e32-a618-2f7508f0c0cd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:17.627208 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-eabc2ba5-bf4e-4e32-a618-2f7508f0c0cd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:17.627714 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-eabc2ba5-bf4e-4e32-a618-2f7508f0c0cd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:17.628554 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-eabc2ba5-bf4e-4e32-a618-2f7508f0c0cd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:17.629048 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-eabc2ba5-bf4e-4e32-a618-2f7508f0c0cd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:17.661302 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-57d7b03e-f38a-4ec2-8f9c-b07198328504 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "POST /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.411722 Feb 19 02:31:17.662060 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 374/715] 10.222.0.44 () {60 vars in 1313 bytes} [Fri Feb 19 02:31:17 2021] POST /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871/os-volume_attachments => generated 194 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:31:17.670400 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-02bc4135-b9bc-4351-9912-67f515b8a144 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-469518843", "imageRef": "37a0f9d8-d3f7-417e-bce6-371e41a47c88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fcb9e503-6dc6-4ac0-9d1f-9b46f2bce723"}], "security_groups": [{"name": "tempest-securitygroup--107369795"}], "key_name": "tempest-keypair-53938536", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:17.760269 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-eabc2ba5-bf4e-4e32-a618-2f7508f0c0cd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 28246 microversion: 2.20 time: 0.146327 Feb 19 02:31:17.761880 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 342/716] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:17 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 28246 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:31:17.813348 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-02bc4135-b9bc-4351-9912-67f515b8a144 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] validate_networks() for [('fcb9e503-6dc6-4ac0-9d1f-9b46f2bce723', None, None, None)] {{(pid=98193) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 02:31:18.552952 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-02bc4135-b9bc-4351-9912-67f515b8a144 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Flavor limits 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 02:31:18.553426 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-02bc4135-b9bc-4351-9912-67f515b8a144 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Image limits 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 02:31:18.553933 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-02bc4135-b9bc-4351-9912-67f515b8a144 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Flavor pref 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 02:31:18.554411 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-02bc4135-b9bc-4351-9912-67f515b8a144 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Image pref 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 02:31:18.555111 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-02bc4135-b9bc-4351-9912-67f515b8a144 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 02:31:18.564182 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-02bc4135-b9bc-4351-9912-67f515b8a144 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:18.564722 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-02bc4135-b9bc-4351-9912-67f515b8a144 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:18.565703 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-02bc4135-b9bc-4351-9912-67f515b8a144 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:18.566256 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-02bc4135-b9bc-4351-9912-67f515b8a144 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:18.589813 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-02bc4135-b9bc-4351-9912-67f515b8a144 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Getting quotas for project ce3f0058e9cc413c9235ce9b044f5d1f. Resources: {'ram', 'instances', 'cores'} {{(pid=98193) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:31:18.594275 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-02bc4135-b9bc-4351-9912-67f515b8a144 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Getting quotas for user f95ba89e87bd4588a0c6c3593a6a4071 and project ce3f0058e9cc413c9235ce9b044f5d1f. Resources: {'ram', 'instances', 'cores'} {{(pid=98193) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:31:18.606509 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-02bc4135-b9bc-4351-9912-67f515b8a144 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Going to run 1 instances... {{(pid=98193) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 02:31:18.609767 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-02bc4135-b9bc-4351-9912-67f515b8a144 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='37a0f9d8-d3f7-417e-bce6-371e41a47c88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 02:31:18.677371 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-02bc4135-b9bc-4351-9912-67f515b8a144 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.011703 Feb 19 02:31:18.678031 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 375/717] 10.222.0.44 () {60 vars in 1137 bytes} [Fri Feb 19 02:31:17 2021] POST /compute/v2.1/servers => generated 401 bytes in 1013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Feb 19 02:31:18.695188 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-2cc62539-26a1-413d-8f41-b3665bbc8e31 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:18.695621 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-2cc62539-26a1-413d-8f41-b3665bbc8e31 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:18.773622 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-05569909-72be-4ec1-9c84-66853034fed0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:18.774789 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-05569909-72be-4ec1-9c84-66853034fed0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:18.788879 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-05569909-72be-4ec1-9c84-66853034fed0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:18.789684 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-05569909-72be-4ec1-9c84-66853034fed0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:18.790907 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-05569909-72be-4ec1-9c84-66853034fed0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:18.791586 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-05569909-72be-4ec1-9c84-66853034fed0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:18.798234 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-2cc62539-26a1-413d-8f41-b3665bbc8e31 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:18.819635 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-2cc62539-26a1-413d-8f41-b3665bbc8e31 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3" status: 200 len: 1235 microversion: 2.1 time: 0.134509 Feb 19 02:31:18.820333 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 343/718] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:18 2021] GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3 => generated 1235 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:31:18.914681 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-05569909-72be-4ec1-9c84-66853034fed0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 28246 microversion: 2.20 time: 0.145014 Feb 19 02:31:18.918124 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 376/719] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:18 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 28246 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 19 02:31:19.838854 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-6d154dc4-94ea-4eeb-8206-c6dd351ff3b5 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:19.839523 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-6d154dc4-94ea-4eeb-8206-c6dd351ff3b5 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:19.848706 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6d154dc4-94ea-4eeb-8206-c6dd351ff3b5 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:19.849263 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6d154dc4-94ea-4eeb-8206-c6dd351ff3b5 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:19.850840 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6d154dc4-94ea-4eeb-8206-c6dd351ff3b5 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:19.851273 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6d154dc4-94ea-4eeb-8206-c6dd351ff3b5 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:19.929404 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f83f8420-1ecd-4bd6-b5c5-4d80a845f572 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:19.930828 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f83f8420-1ecd-4bd6-b5c5-4d80a845f572 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:19.951985 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f83f8420-1ecd-4bd6-b5c5-4d80a845f572 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:19.952486 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f83f8420-1ecd-4bd6-b5c5-4d80a845f572 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:19.953335 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f83f8420-1ecd-4bd6-b5c5-4d80a845f572 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:19.953818 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f83f8420-1ecd-4bd6-b5c5-4d80a845f572 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:19.977371 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-6d154dc4-94ea-4eeb-8206-c6dd351ff3b5 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:19.986457 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-6d154dc4-94ea-4eeb-8206-c6dd351ff3b5 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3" status: 200 len: 1287 microversion: 2.1 time: 0.151690 Feb 19 02:31:19.987747 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 344/720] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:19 2021] GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3 => generated 1287 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:31:20.095071 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f83f8420-1ecd-4bd6-b5c5-4d80a845f572 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 28537 microversion: 2.20 time: 0.169947 Feb 19 02:31:20.096161 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 377/721] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:19 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 28537 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:31:21.005376 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e03ac7aa-b498-4c8a-95b3-a66c9e5fafa7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:21.006571 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e03ac7aa-b498-4c8a-95b3-a66c9e5fafa7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:21.014456 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e03ac7aa-b498-4c8a-95b3-a66c9e5fafa7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:21.014967 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e03ac7aa-b498-4c8a-95b3-a66c9e5fafa7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:21.015805 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e03ac7aa-b498-4c8a-95b3-a66c9e5fafa7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:21.016299 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e03ac7aa-b498-4c8a-95b3-a66c9e5fafa7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:21.108525 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-44d5fd38-5d3a-4f37-9c74-c87c8d284c96 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:21.109653 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-44d5fd38-5d3a-4f37-9c74-c87c8d284c96 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:21.118624 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-44d5fd38-5d3a-4f37-9c74-c87c8d284c96 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:21.119130 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-44d5fd38-5d3a-4f37-9c74-c87c8d284c96 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:21.119962 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-44d5fd38-5d3a-4f37-9c74-c87c8d284c96 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:21.120446 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-44d5fd38-5d3a-4f37-9c74-c87c8d284c96 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:21.183046 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e03ac7aa-b498-4c8a-95b3-a66c9e5fafa7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:21.192749 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e03ac7aa-b498-4c8a-95b3-a66c9e5fafa7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3" status: 200 len: 1293 microversion: 2.1 time: 0.191329 Feb 19 02:31:21.194322 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 345/722] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:21 2021] GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3 => generated 1293 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:31:22.213130 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-2e4e64ae-d88a-43b5-be79-b6fe682f5f11 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:22.213791 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-2e4e64ae-d88a-43b5-be79-b6fe682f5f11 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:22.222180 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2e4e64ae-d88a-43b5-be79-b6fe682f5f11 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:22.222709 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2e4e64ae-d88a-43b5-be79-b6fe682f5f11 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:22.223532 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2e4e64ae-d88a-43b5-be79-b6fe682f5f11 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:22.224014 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2e4e64ae-d88a-43b5-be79-b6fe682f5f11 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:22.451148 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-2e4e64ae-d88a-43b5-be79-b6fe682f5f11 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:22.460133 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-2e4e64ae-d88a-43b5-be79-b6fe682f5f11 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3" status: 200 len: 1360 microversion: 2.1 time: 0.251050 Feb 19 02:31:22.460752 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 346/723] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:22 2021] GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3 => generated 1360 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:31:23.020189 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-44d5fd38-5d3a-4f37-9c74-c87c8d284c96 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 28704 microversion: 2.20 time: 1.916115 Feb 19 02:31:23.025050 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 378/724] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:21 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 28704 bytes in 1919 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 19 02:31:23.478869 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-89132ebe-2680-40dd-a10b-6a5f4bab0b50 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:23.479539 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-89132ebe-2680-40dd-a10b-6a5f4bab0b50 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:23.487532 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-89132ebe-2680-40dd-a10b-6a5f4bab0b50 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:23.488046 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-89132ebe-2680-40dd-a10b-6a5f4bab0b50 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:23.488890 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-89132ebe-2680-40dd-a10b-6a5f4bab0b50 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:23.489420 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-89132ebe-2680-40dd-a10b-6a5f4bab0b50 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:23.699746 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-89132ebe-2680-40dd-a10b-6a5f4bab0b50 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:23.708812 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-89132ebe-2680-40dd-a10b-6a5f4bab0b50 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3" status: 200 len: 1360 microversion: 2.1 time: 0.234650 Feb 19 02:31:23.709426 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 347/725] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:23 2021] GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3 => generated 1360 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:31:24.034123 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-63ff0d2e-062b-4ff9-b35b-904e6f87a6c8 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:24.035270 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-63ff0d2e-062b-4ff9-b35b-904e6f87a6c8 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:24.044397 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-63ff0d2e-062b-4ff9-b35b-904e6f87a6c8 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:24.044897 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-63ff0d2e-062b-4ff9-b35b-904e6f87a6c8 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:24.047129 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-63ff0d2e-062b-4ff9-b35b-904e6f87a6c8 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:24.047612 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-63ff0d2e-062b-4ff9-b35b-904e6f87a6c8 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:24.169193 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-63ff0d2e-062b-4ff9-b35b-904e6f87a6c8 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 28704 microversion: 2.20 time: 0.139379 Feb 19 02:31:24.171083 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 379/726] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:24 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 28704 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:31:24.727130 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-9550da19-cd3e-4eae-bb23-1aa35ff5a1db tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:24.727714 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-9550da19-cd3e-4eae-bb23-1aa35ff5a1db tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:24.735729 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9550da19-cd3e-4eae-bb23-1aa35ff5a1db tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:24.736231 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9550da19-cd3e-4eae-bb23-1aa35ff5a1db tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:24.737066 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9550da19-cd3e-4eae-bb23-1aa35ff5a1db tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:24.737554 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9550da19-cd3e-4eae-bb23-1aa35ff5a1db tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:25.183003 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-83b2e22b-2e71-4522-a9d3-b148974d4987 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:25.184147 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-83b2e22b-2e71-4522-a9d3-b148974d4987 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:25.198661 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-83b2e22b-2e71-4522-a9d3-b148974d4987 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:25.199162 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-83b2e22b-2e71-4522-a9d3-b148974d4987 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:25.200011 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-83b2e22b-2e71-4522-a9d3-b148974d4987 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:25.200499 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-83b2e22b-2e71-4522-a9d3-b148974d4987 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:25.256616 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9550da19-cd3e-4eae-bb23-1aa35ff5a1db tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:25.273899 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-9550da19-cd3e-4eae-bb23-1aa35ff5a1db tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3" status: 200 len: 1360 microversion: 2.1 time: 0.550776 Feb 19 02:31:25.275488 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 348/727] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:24 2021] GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3 => generated 1360 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:31:25.371618 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-83b2e22b-2e71-4522-a9d3-b148974d4987 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 28704 microversion: 2.20 time: 0.193639 Feb 19 02:31:25.374806 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 380/728] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:25 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 28704 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:31:25.647518 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-2eddc1e9-e6b3-4bd4-8574-ee9ffd3c2f61 req-a87a83f4-dca0-423f-97c0-a923e1607338 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0218d9a-e330-4ef2-8a16-e156c2e24cd3", "tag": "d739dca4-9cc8-47ad-84ac-4ada4b45be64"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:25.653551 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:31:25.653551 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:31:25.663676 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-2eddc1e9-e6b3-4bd4-8574-ee9ffd3c2f61 req-a87a83f4-dca0-423f-97c0-a923e1607338 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:25.666940 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-2eddc1e9-e6b3-4bd4-8574-ee9ffd3c2f61 req-a87a83f4-dca0-423f-97c0-a923e1607338 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:25.713844 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-2eddc1e9-e6b3-4bd4-8574-ee9ffd3c2f61 req-a87a83f4-dca0-423f-97c0-a923e1607338 service nova] Creating event network-changed:d739dca4-9cc8-47ad-84ac-4ada4b45be64 for instance f0218d9a-e330-4ef2-8a16-e156c2e24cd3 on hv-cinder-77642 Feb 19 02:31:25.719713 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-2eddc1e9-e6b3-4bd4-8574-ee9ffd3c2f61 req-a87a83f4-dca0-423f-97c0-a923e1607338 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076109 Feb 19 02:31:25.720711 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 349/729] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:31:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:31:26.294036 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a67d613e-bf13-44be-90ec-77c4a13e74f2 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:26.294782 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a67d613e-bf13-44be-90ec-77c4a13e74f2 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:26.304663 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a67d613e-bf13-44be-90ec-77c4a13e74f2 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:26.305439 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a67d613e-bf13-44be-90ec-77c4a13e74f2 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:26.306507 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a67d613e-bf13-44be-90ec-77c4a13e74f2 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:26.307191 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a67d613e-bf13-44be-90ec-77c4a13e74f2 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:26.385250 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-0f599169-c747-4c88-ac67-520324c28301 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:26.386675 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-0f599169-c747-4c88-ac67-520324c28301 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:26.395666 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0f599169-c747-4c88-ac67-520324c28301 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:26.396377 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0f599169-c747-4c88-ac67-520324c28301 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:26.397354 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0f599169-c747-4c88-ac67-520324c28301 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:26.397960 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0f599169-c747-4c88-ac67-520324c28301 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:26.534651 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a67d613e-bf13-44be-90ec-77c4a13e74f2 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:26.543716 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a67d613e-bf13-44be-90ec-77c4a13e74f2 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3" status: 200 len: 1360 microversion: 2.1 time: 0.254243 Feb 19 02:31:26.544394 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 381/730] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:26 2021] GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3 => generated 1360 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:31:27.562584 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-06aff258-8fc3-4064-b8e7-2ee6cf81a5b7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:27.563251 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-06aff258-8fc3-4064-b8e7-2ee6cf81a5b7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:27.572276 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-06aff258-8fc3-4064-b8e7-2ee6cf81a5b7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:27.572779 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-06aff258-8fc3-4064-b8e7-2ee6cf81a5b7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:27.573616 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-06aff258-8fc3-4064-b8e7-2ee6cf81a5b7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:27.574107 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-06aff258-8fc3-4064-b8e7-2ee6cf81a5b7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:27.779632 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-06aff258-8fc3-4064-b8e7-2ee6cf81a5b7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:27.788823 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-06aff258-8fc3-4064-b8e7-2ee6cf81a5b7 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3" status: 200 len: 1360 microversion: 2.1 time: 0.230413 Feb 19 02:31:27.789446 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 382/731] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:27 2021] GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3 => generated 1360 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:31:28.807000 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-bbb2a7ee-2e9a-409a-b422-48d646c87ef0 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:28.807589 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-bbb2a7ee-2e9a-409a-b422-48d646c87ef0 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:28.815508 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bbb2a7ee-2e9a-409a-b422-48d646c87ef0 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:28.816003 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bbb2a7ee-2e9a-409a-b422-48d646c87ef0 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:28.816819 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bbb2a7ee-2e9a-409a-b422-48d646c87ef0 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:28.817301 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bbb2a7ee-2e9a-409a-b422-48d646c87ef0 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:29.029538 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-bbb2a7ee-2e9a-409a-b422-48d646c87ef0 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:29.039321 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-bbb2a7ee-2e9a-409a-b422-48d646c87ef0 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3" status: 200 len: 1360 microversion: 2.1 time: 0.236341 Feb 19 02:31:29.040006 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 383/732] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:28 2021] GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3 => generated 1360 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:31:29.164935 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-0f599169-c747-4c88-ac67-520324c28301 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 28704 microversion: 2.20 time: 2.784585 Feb 19 02:31:29.166846 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 350/733] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:26 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 28704 bytes in 2787 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 19 02:31:30.058010 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4f0617cf-91db-4843-a5df-b3de93e2ccdb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:30.058699 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-4f0617cf-91db-4843-a5df-b3de93e2ccdb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:30.066945 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4f0617cf-91db-4843-a5df-b3de93e2ccdb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:30.067449 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4f0617cf-91db-4843-a5df-b3de93e2ccdb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:30.068939 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4f0617cf-91db-4843-a5df-b3de93e2ccdb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:30.069420 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4f0617cf-91db-4843-a5df-b3de93e2ccdb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:30.179687 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e7f7de31-a022-4bdc-bc78-649ec700ab98 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:30.180252 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e7f7de31-a022-4bdc-bc78-649ec700ab98 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:30.188914 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e7f7de31-a022-4bdc-bc78-649ec700ab98 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:30.189467 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e7f7de31-a022-4bdc-bc78-649ec700ab98 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:30.190266 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e7f7de31-a022-4bdc-bc78-649ec700ab98 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:30.190841 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e7f7de31-a022-4bdc-bc78-649ec700ab98 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:30.291677 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-4f0617cf-91db-4843-a5df-b3de93e2ccdb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:30.299484 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e7f7de31-a022-4bdc-bc78-649ec700ab98 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 28704 microversion: 2.20 time: 0.125462 Feb 19 02:31:30.300172 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 351/734] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:30 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 28704 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 19 02:31:30.304781 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-4f0617cf-91db-4843-a5df-b3de93e2ccdb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3" status: 200 len: 1360 microversion: 2.1 time: 0.250639 Feb 19 02:31:30.305426 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 384/735] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:30 2021] GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3 => generated 1360 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:31:31.313644 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d93ec5cf-b173-452e-b438-36a264e92fce tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:31.314799 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d93ec5cf-b173-452e-b438-36a264e92fce tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:31.323733 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-30cd6c20-3cfd-455a-917d-82e2ad0cae07 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:31.323897 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d93ec5cf-b173-452e-b438-36a264e92fce tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:31.324374 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d93ec5cf-b173-452e-b438-36a264e92fce tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:31.324504 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-30cd6c20-3cfd-455a-917d-82e2ad0cae07 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:31.325209 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d93ec5cf-b173-452e-b438-36a264e92fce tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:31.325719 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d93ec5cf-b173-452e-b438-36a264e92fce tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:31.332520 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-30cd6c20-3cfd-455a-917d-82e2ad0cae07 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:31.333026 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-30cd6c20-3cfd-455a-917d-82e2ad0cae07 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:31.334472 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-30cd6c20-3cfd-455a-917d-82e2ad0cae07 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:31.334965 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-30cd6c20-3cfd-455a-917d-82e2ad0cae07 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:31.542181 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-30cd6c20-3cfd-455a-917d-82e2ad0cae07 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:31.551011 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-30cd6c20-3cfd-455a-917d-82e2ad0cae07 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3" status: 200 len: 1360 microversion: 2.1 time: 0.231272 Feb 19 02:31:31.551630 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 385/736] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:31 2021] GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3 => generated 1360 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:31:32.569871 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5386c647-d102-433b-8039-0f2ff9f2699a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:32.570563 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5386c647-d102-433b-8039-0f2ff9f2699a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:32.578770 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5386c647-d102-433b-8039-0f2ff9f2699a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:32.579278 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5386c647-d102-433b-8039-0f2ff9f2699a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:32.580108 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5386c647-d102-433b-8039-0f2ff9f2699a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:32.580596 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5386c647-d102-433b-8039-0f2ff9f2699a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:32.791725 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5386c647-d102-433b-8039-0f2ff9f2699a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:32.800446 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5386c647-d102-433b-8039-0f2ff9f2699a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3" status: 200 len: 1360 microversion: 2.1 time: 0.235262 Feb 19 02:31:32.801068 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 386/737] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:32 2021] GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3 => generated 1360 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:31:33.706752 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d93ec5cf-b173-452e-b438-36a264e92fce tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 28704 microversion: 2.20 time: 2.397508 Feb 19 02:31:33.707457 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 352/738] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:31 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 28704 bytes in 2400 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:31:33.819250 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f09cb661-a5ad-4a86-8c7e-8d22aab382ab tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:33.819904 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f09cb661-a5ad-4a86-8c7e-8d22aab382ab tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:33.828057 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f09cb661-a5ad-4a86-8c7e-8d22aab382ab tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:33.828556 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f09cb661-a5ad-4a86-8c7e-8d22aab382ab tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:33.829381 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f09cb661-a5ad-4a86-8c7e-8d22aab382ab tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:33.829867 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f09cb661-a5ad-4a86-8c7e-8d22aab382ab tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:34.055697 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f09cb661-a5ad-4a86-8c7e-8d22aab382ab tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:34.064852 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f09cb661-a5ad-4a86-8c7e-8d22aab382ab tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3" status: 200 len: 1360 microversion: 2.1 time: 0.249857 Feb 19 02:31:34.065472 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 387/739] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:33 2021] GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3 => generated 1360 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:31:34.571861 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-b3d5d04a-ba89-408b-961f-9eff74e358b1 req-18923f74-24ef-4abf-a1dd-564d9a8a2868 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0218d9a-e330-4ef2-8a16-e156c2e24cd3", "name": "network-vif-plugged", "status": "completed", "tag": "d739dca4-9cc8-47ad-84ac-4ada4b45be64"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:34.573490 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:31:34.573490 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:31:34.584124 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-b3d5d04a-ba89-408b-961f-9eff74e358b1 req-18923f74-24ef-4abf-a1dd-564d9a8a2868 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:34.584624 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-b3d5d04a-ba89-408b-961f-9eff74e358b1 req-18923f74-24ef-4abf-a1dd-564d9a8a2868 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:34.601952 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-b3d5d04a-ba89-408b-961f-9eff74e358b1 req-18923f74-24ef-4abf-a1dd-564d9a8a2868 service nova] Creating event network-vif-plugged:d739dca4-9cc8-47ad-84ac-4ada4b45be64 for instance f0218d9a-e330-4ef2-8a16-e156c2e24cd3 on hv-cinder-77642 Feb 19 02:31:34.607120 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-b3d5d04a-ba89-408b-961f-9eff74e358b1 req-18923f74-24ef-4abf-a1dd-564d9a8a2868 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040510 Feb 19 02:31:34.607954 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 353/740] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:31:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:31:35.016944 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7165a47f-2423-4911-8994-5e2b287b5759 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:35.018016 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7165a47f-2423-4911-8994-5e2b287b5759 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:35.025999 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7165a47f-2423-4911-8994-5e2b287b5759 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:35.026561 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7165a47f-2423-4911-8994-5e2b287b5759 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:35.027407 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7165a47f-2423-4911-8994-5e2b287b5759 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:35.027912 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7165a47f-2423-4911-8994-5e2b287b5759 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:35.084141 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-96823ff4-694b-49a9-96a0-5f78d9563072 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:35.084922 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-96823ff4-694b-49a9-96a0-5f78d9563072 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:35.093979 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-96823ff4-694b-49a9-96a0-5f78d9563072 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:35.094578 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-96823ff4-694b-49a9-96a0-5f78d9563072 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:35.095430 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-96823ff4-694b-49a9-96a0-5f78d9563072 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:35.095931 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-96823ff4-694b-49a9-96a0-5f78d9563072 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:35.312621 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-96823ff4-694b-49a9-96a0-5f78d9563072 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:35.321596 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-96823ff4-694b-49a9-96a0-5f78d9563072 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3" status: 200 len: 1360 microversion: 2.1 time: 0.242161 Feb 19 02:31:35.322219 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 354/741] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:35 2021] GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3 => generated 1360 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:31:35.337737 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7165a47f-2423-4911-8994-5e2b287b5759 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 28704 microversion: 2.20 time: 0.621986 Feb 19 02:31:35.338464 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 388/742] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:34 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 28704 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:31:36.341288 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-2888b761-da12-41d1-b325-13d5fe9c1ba3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:36.342553 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-2888b761-da12-41d1-b325-13d5fe9c1ba3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:36.351053 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-946c6373-61e8-4215-8f5d-b056003b7057 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:36.352187 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-946c6373-61e8-4215-8f5d-b056003b7057 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:36.352766 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2888b761-da12-41d1-b325-13d5fe9c1ba3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:36.353465 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2888b761-da12-41d1-b325-13d5fe9c1ba3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:36.354549 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2888b761-da12-41d1-b325-13d5fe9c1ba3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:36.355242 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2888b761-da12-41d1-b325-13d5fe9c1ba3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:36.361158 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-946c6373-61e8-4215-8f5d-b056003b7057 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:36.361661 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-946c6373-61e8-4215-8f5d-b056003b7057 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:36.362534 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-946c6373-61e8-4215-8f5d-b056003b7057 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:36.363020 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-946c6373-61e8-4215-8f5d-b056003b7057 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:36.496097 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-946c6373-61e8-4215-8f5d-b056003b7057 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 29679 microversion: 2.20 time: 0.150040 Feb 19 02:31:36.497257 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 389/743] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:36 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 29679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:31:36.572608 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-2888b761-da12-41d1-b325-13d5fe9c1ba3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:36.581696 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-2888b761-da12-41d1-b325-13d5fe9c1ba3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3" status: 200 len: 1360 microversion: 2.1 time: 0.245157 Feb 19 02:31:36.582346 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 355/744] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:36 2021] GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3 => generated 1360 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:31:37.509859 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-23c1d39f-c9d0-48c8-b0d7-0a0c551837bd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:37.511038 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-23c1d39f-c9d0-48c8-b0d7-0a0c551837bd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:37.520054 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-23c1d39f-c9d0-48c8-b0d7-0a0c551837bd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:37.520225 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-23c1d39f-c9d0-48c8-b0d7-0a0c551837bd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:37.521687 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-23c1d39f-c9d0-48c8-b0d7-0a0c551837bd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:37.522178 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-23c1d39f-c9d0-48c8-b0d7-0a0c551837bd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:37.600216 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-845320cd-619d-4749-85e2-c64a62458f86 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:37.600882 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-845320cd-619d-4749-85e2-c64a62458f86 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:37.608753 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-845320cd-619d-4749-85e2-c64a62458f86 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:37.609255 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-845320cd-619d-4749-85e2-c64a62458f86 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:37.610270 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-845320cd-619d-4749-85e2-c64a62458f86 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:37.610900 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-845320cd-619d-4749-85e2-c64a62458f86 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:37.649807 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-23c1d39f-c9d0-48c8-b0d7-0a0c551837bd tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 31065 microversion: 2.20 time: 0.144690 Feb 19 02:31:37.654233 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 390/745] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:37 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 31065 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:31:37.832151 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-845320cd-619d-4749-85e2-c64a62458f86 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:37.841051 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-845320cd-619d-4749-85e2-c64a62458f86 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3" status: 200 len: 1545 microversion: 2.1 time: 0.244966 Feb 19 02:31:37.841716 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 356/746] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:37 2021] GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3 => generated 1545 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:31:37.859171 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-20848f85-4902-4417-a51c-7852d90f064a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:37.859818 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-20848f85-4902-4417-a51c-7852d90f064a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:37.869123 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-20848f85-4902-4417-a51c-7852d90f064a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:37.869631 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-20848f85-4902-4417-a51c-7852d90f064a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:37.870488 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-20848f85-4902-4417-a51c-7852d90f064a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:37.870986 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-20848f85-4902-4417-a51c-7852d90f064a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:38.038173 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-20848f85-4902-4417-a51c-7852d90f064a tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.183354 Feb 19 02:31:38.038977 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 391/747] 10.222.0.44 () {58 vars in 1265 bytes} [Fri Feb 19 02:31:37 2021] GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/os-interface => generated 284 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:31:38.184338 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-84e1638a-542f-4061-946e-ae64711e29b4 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:38.184888 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-84e1638a-542f-4061-946e-ae64711e29b4 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2f547266-6472-46d2-a651-03a6dab0b871] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:38.192785 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-84e1638a-542f-4061-946e-ae64711e29b4 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:38.193292 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-84e1638a-542f-4061-946e-ae64711e29b4 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:38.194127 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-84e1638a-542f-4061-946e-ae64711e29b4 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:38.194660 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-84e1638a-542f-4061-946e-ae64711e29b4 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:38.369526 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.objects.instance [None req-84e1638a-542f-4061-946e-ae64711e29b4 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lazy-loading 'services' on Instance uuid 2f547266-6472-46d2-a651-03a6dab0b871 {{(pid=98194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 02:31:38.515840 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-84e1638a-542f-4061-946e-ae64711e29b4 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "DELETE /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871/os-volume_attachments/53310f07-a5d1-4b0d-b1c3-1c6b2af0f56f" status: 202 len: 0 microversion: 2.1 time: 0.335227 Feb 19 02:31:38.516716 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 357/748] 10.222.0.44 () {58 vars in 1406 bytes} [Fri Feb 19 02:31:38 2021] DELETE /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871/os-volume_attachments/53310f07-a5d1-4b0d-b1c3-1c6b2af0f56f => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:31:38.662215 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-3734cae7-c646-4e8e-aa48-4f7416d5c579 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:38.663292 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-3734cae7-c646-4e8e-aa48-4f7416d5c579 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:38.671507 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3734cae7-c646-4e8e-aa48-4f7416d5c579 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:38.672017 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3734cae7-c646-4e8e-aa48-4f7416d5c579 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:38.672849 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3734cae7-c646-4e8e-aa48-4f7416d5c579 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:38.673505 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3734cae7-c646-4e8e-aa48-4f7416d5c579 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:38.846779 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-3734cae7-c646-4e8e-aa48-4f7416d5c579 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 32088 microversion: 2.20 time: 0.188805 Feb 19 02:31:38.850446 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 392/749] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:38 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 32088 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:31:39.740832 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5d5b29e9-a6da-46f9-bca0-d7b2613324ce tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:39.741580 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5d5b29e9-a6da-46f9-bca0-d7b2613324ce tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2f547266-6472-46d2-a651-03a6dab0b871] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:39.749793 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5d5b29e9-a6da-46f9-bca0-d7b2613324ce tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:39.750391 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5d5b29e9-a6da-46f9-bca0-d7b2613324ce tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:39.751309 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5d5b29e9-a6da-46f9-bca0-d7b2613324ce tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:39.751826 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5d5b29e9-a6da-46f9-bca0-d7b2613324ce tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:39.823660 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5d5b29e9-a6da-46f9-bca0-d7b2613324ce tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2f547266-6472-46d2-a651-03a6dab0b871] Going to try to terminate instance {{(pid=98194) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 02:31:39.854438 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-40c629f4-b670-4adb-900a-d5e4b833faae tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:39.855656 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-40c629f4-b670-4adb-900a-d5e4b833faae tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:39.864306 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-40c629f4-b670-4adb-900a-d5e4b833faae tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:39.865499 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-40c629f4-b670-4adb-900a-d5e4b833faae tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:39.866430 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-40c629f4-b670-4adb-900a-d5e4b833faae tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:39.866936 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-40c629f4-b670-4adb-900a-d5e4b833faae tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:39.969291 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5d5b29e9-a6da-46f9-bca0-d7b2613324ce tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "DELETE /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871" status: 204 len: 0 microversion: 2.1 time: 0.232831 Feb 19 02:31:39.969958 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 358/750] 10.222.0.44 () {58 vars in 1229 bytes} [Fri Feb 19 02:31:39 2021] DELETE /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 02:31:39.999592 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-40c629f4-b670-4adb-900a-d5e4b833faae tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 14 microversion: 2.1 time: 0.149988 Feb 19 02:31:40.000279 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 393/751] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:31:39 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 19 02:31:40.006406 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-6d77eef3-d301-4ae7-8c45-ff004a674a14 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:40.007375 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-6d77eef3-d301-4ae7-8c45-ff004a674a14 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:40.015884 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6d77eef3-d301-4ae7-8c45-ff004a674a14 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:40.016619 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6d77eef3-d301-4ae7-8c45-ff004a674a14 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:40.017468 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6d77eef3-d301-4ae7-8c45-ff004a674a14 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:40.018130 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6d77eef3-d301-4ae7-8c45-ff004a674a14 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:40.040915 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-661dbbd5-d4b8-422d-b60f-b3dd09d0e889 req-b9e56116-963b-4283-a084-35dac7c3474e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0218d9a-e330-4ef2-8a16-e156c2e24cd3", "tag": "d739dca4-9cc8-47ad-84ac-4ada4b45be64"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:40.042647 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:31:40.042647 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:31:40.051599 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-661dbbd5-d4b8-422d-b60f-b3dd09d0e889 req-b9e56116-963b-4283-a084-35dac7c3474e service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:40.052146 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-661dbbd5-d4b8-422d-b60f-b3dd09d0e889 req-b9e56116-963b-4283-a084-35dac7c3474e service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:40.069708 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-661dbbd5-d4b8-422d-b60f-b3dd09d0e889 req-b9e56116-963b-4283-a084-35dac7c3474e service nova] Creating event network-changed:d739dca4-9cc8-47ad-84ac-4ada4b45be64 for instance f0218d9a-e330-4ef2-8a16-e156c2e24cd3 on hv-cinder-77642 Feb 19 02:31:40.074785 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-661dbbd5-d4b8-422d-b60f-b3dd09d0e889 req-b9e56116-963b-4283-a084-35dac7c3474e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103356 Feb 19 02:31:40.075427 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 359/752] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:31:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:31:40.080986 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c7a6b06a-733b-45ed-bbbe-c455f2d55166 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:40.081734 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c7a6b06a-733b-45ed-bbbe-c455f2d55166 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2f547266-6472-46d2-a651-03a6dab0b871] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:40.091563 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c7a6b06a-733b-45ed-bbbe-c455f2d55166 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:40.092541 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c7a6b06a-733b-45ed-bbbe-c455f2d55166 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:40.093402 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c7a6b06a-733b-45ed-bbbe-c455f2d55166 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:40.093903 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c7a6b06a-733b-45ed-bbbe-c455f2d55166 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:40.170596 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-6d77eef3-d301-4ae7-8c45-ff004a674a14 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 32962 microversion: 2.20 time: 0.168227 Feb 19 02:31:40.171949 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 394/753] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:40 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 32962 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:31:40.436004 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c7a6b06a-733b-45ed-bbbe-c455f2d55166 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da5618e5a5640c28593881e6d144469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd5f2d3f10452aa7848bc1d229dfdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:40.445663 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c7a6b06a-733b-45ed-bbbe-c455f2d55166 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871" status: 200 len: 1513 microversion: 2.1 time: 0.368958 Feb 19 02:31:40.446523 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 360/754] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:40 2021] GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871 => generated 1513 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:31:41.141820 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-061f67a3-c34a-4ff8-a69f-081241c53e64 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:41.143070 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-061f67a3-c34a-4ff8-a69f-081241c53e64 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:41.151900 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-061f67a3-c34a-4ff8-a69f-081241c53e64 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:41.152410 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-061f67a3-c34a-4ff8-a69f-081241c53e64 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:41.153250 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-061f67a3-c34a-4ff8-a69f-081241c53e64 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:41.153741 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-061f67a3-c34a-4ff8-a69f-081241c53e64 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:41.183816 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-63df7bf1-39b5-4aaf-8a5d-a2fed6abdaf3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:41.186434 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-63df7bf1-39b5-4aaf-8a5d-a2fed6abdaf3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:41.193436 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-63df7bf1-39b5-4aaf-8a5d-a2fed6abdaf3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:41.193936 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-63df7bf1-39b5-4aaf-8a5d-a2fed6abdaf3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:41.194813 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-63df7bf1-39b5-4aaf-8a5d-a2fed6abdaf3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:41.195304 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-63df7bf1-39b5-4aaf-8a5d-a2fed6abdaf3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:41.262019 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-061f67a3-c34a-4ff8-a69f-081241c53e64 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 14 microversion: 2.1 time: 0.254159 Feb 19 02:31:41.262736 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 395/755] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:31:41 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 14 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:31:41.332299 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-63df7bf1-39b5-4aaf-8a5d-a2fed6abdaf3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 33274 microversion: 2.20 time: 0.152270 Feb 19 02:31:41.333290 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 361/756] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:41 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 33274 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 19 02:31:41.466208 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-de6c9b9e-e1b3-46ac-87f3-1778ae9fcfa8 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:41.467021 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-de6c9b9e-e1b3-46ac-87f3-1778ae9fcfa8 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2f547266-6472-46d2-a651-03a6dab0b871] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:41.477988 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-de6c9b9e-e1b3-46ac-87f3-1778ae9fcfa8 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:41.478521 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-de6c9b9e-e1b3-46ac-87f3-1778ae9fcfa8 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:41.479385 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-de6c9b9e-e1b3-46ac-87f3-1778ae9fcfa8 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:41.479887 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-de6c9b9e-e1b3-46ac-87f3-1778ae9fcfa8 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:41.700985 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-de6c9b9e-e1b3-46ac-87f3-1778ae9fcfa8 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da5618e5a5640c28593881e6d144469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd5f2d3f10452aa7848bc1d229dfdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:41.710217 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-de6c9b9e-e1b3-46ac-87f3-1778ae9fcfa8 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871" status: 200 len: 1513 microversion: 2.1 time: 0.248662 Feb 19 02:31:41.710875 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 396/757] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:41 2021] GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871 => generated 1513 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:31:42.275051 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ee804275-8d9e-48d9-9f8e-4a266f7831d3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:42.276170 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ee804275-8d9e-48d9-9f8e-4a266f7831d3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:42.284797 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ee804275-8d9e-48d9-9f8e-4a266f7831d3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:42.285309 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ee804275-8d9e-48d9-9f8e-4a266f7831d3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:42.286220 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ee804275-8d9e-48d9-9f8e-4a266f7831d3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:42.287306 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ee804275-8d9e-48d9-9f8e-4a266f7831d3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:42.345509 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-13158ec0-33b7-4d34-a0b4-68b31beb877c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:42.346652 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-13158ec0-33b7-4d34-a0b4-68b31beb877c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:42.355003 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-13158ec0-33b7-4d34-a0b4-68b31beb877c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:42.355508 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-13158ec0-33b7-4d34-a0b4-68b31beb877c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:42.356347 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-13158ec0-33b7-4d34-a0b4-68b31beb877c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:42.356830 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-13158ec0-33b7-4d34-a0b4-68b31beb877c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:42.406718 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ee804275-8d9e-48d9-9f8e-4a266f7831d3 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 14 microversion: 2.1 time: 0.136513 Feb 19 02:31:42.410445 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 362/758] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:31:42 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:31:42.481751 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-13158ec0-33b7-4d34-a0b4-68b31beb877c tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 33572 microversion: 2.20 time: 0.140113 Feb 19 02:31:42.482501 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 397/759] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:42 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 33572 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:31:42.729686 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b96af128-d2c3-464c-9813-2a9622718b9f tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:42.730774 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b96af128-d2c3-464c-9813-2a9622718b9f tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2f547266-6472-46d2-a651-03a6dab0b871] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:42.739571 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b96af128-d2c3-464c-9813-2a9622718b9f tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:42.740080 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b96af128-d2c3-464c-9813-2a9622718b9f tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:42.740929 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b96af128-d2c3-464c-9813-2a9622718b9f tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:42.741421 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b96af128-d2c3-464c-9813-2a9622718b9f tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:43.145359 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-bd575370-b74e-4f13-b441-6f4c7c74a625 req-76df61cf-6bd6-47c3-a01b-bf226a5df1d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f547266-6472-46d2-a651-03a6dab0b871", "name": "network-vif-unplugged", "status": "completed", "tag": "d1b61b95-00d7-4d6d-b713-66c941346701"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:43.147431 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:31:43.147431 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:31:43.157906 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-bd575370-b74e-4f13-b441-6f4c7c74a625 req-76df61cf-6bd6-47c3-a01b-bf226a5df1d4 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:43.158425 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-bd575370-b74e-4f13-b441-6f4c7c74a625 req-76df61cf-6bd6-47c3-a01b-bf226a5df1d4 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:43.179684 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-bd575370-b74e-4f13-b441-6f4c7c74a625 req-76df61cf-6bd6-47c3-a01b-bf226a5df1d4 service nova] Creating event network-vif-unplugged:d1b61b95-00d7-4d6d-b713-66c941346701 for instance 2f547266-6472-46d2-a651-03a6dab0b871 on hv-cinder-77642 Feb 19 02:31:43.184942 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-bd575370-b74e-4f13-b441-6f4c7c74a625 req-76df61cf-6bd6-47c3-a01b-bf226a5df1d4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044641 Feb 19 02:31:43.185762 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 398/760] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:31:43 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:31:43.306102 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b96af128-d2c3-464c-9813-2a9622718b9f tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da5618e5a5640c28593881e6d144469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd5f2d3f10452aa7848bc1d229dfdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:43.315035 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b96af128-d2c3-464c-9813-2a9622718b9f tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871" status: 200 len: 1513 microversion: 2.1 time: 0.589835 Feb 19 02:31:43.315778 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 363/761] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:42 2021] GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871 => generated 1513 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:31:43.419634 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-94f5e23d-0caa-4588-81a5-be95e2e3c4ef tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:43.420757 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-94f5e23d-0caa-4588-81a5-be95e2e3c4ef tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:43.429535 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-94f5e23d-0caa-4588-81a5-be95e2e3c4ef tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:43.430039 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-94f5e23d-0caa-4588-81a5-be95e2e3c4ef tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:43.430894 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-94f5e23d-0caa-4588-81a5-be95e2e3c4ef tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:43.431383 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-94f5e23d-0caa-4588-81a5-be95e2e3c4ef tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:43.495325 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e24c6e4f-47e4-4db5-a160-098eff9f3fc5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:43.496480 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e24c6e4f-47e4-4db5-a160-098eff9f3fc5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:43.504872 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e24c6e4f-47e4-4db5-a160-098eff9f3fc5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:43.505378 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e24c6e4f-47e4-4db5-a160-098eff9f3fc5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:43.506229 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e24c6e4f-47e4-4db5-a160-098eff9f3fc5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:43.506804 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e24c6e4f-47e4-4db5-a160-098eff9f3fc5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:43.531749 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-94f5e23d-0caa-4588-81a5-be95e2e3c4ef tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 14 microversion: 2.1 time: 0.116262 Feb 19 02:31:43.532473 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 399/762] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:31:43 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:31:43.619656 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e24c6e4f-47e4-4db5-a160-098eff9f3fc5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 34254 microversion: 2.20 time: 0.128085 Feb 19 02:31:43.620552 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 364/763] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:43 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 34254 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 19 02:31:44.335503 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-6f3bf1ac-5c9d-4067-b9f6-b254a59d80b7 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:44.336261 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-6f3bf1ac-5c9d-4067-b9f6-b254a59d80b7 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2f547266-6472-46d2-a651-03a6dab0b871] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:44.344904 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6f3bf1ac-5c9d-4067-b9f6-b254a59d80b7 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:44.345411 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6f3bf1ac-5c9d-4067-b9f6-b254a59d80b7 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:44.346239 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6f3bf1ac-5c9d-4067-b9f6-b254a59d80b7 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:44.346747 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6f3bf1ac-5c9d-4067-b9f6-b254a59d80b7 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:44.547521 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-943d23d5-9671-4051-85c5-a91c745ef550 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:44.549091 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-943d23d5-9671-4051-85c5-a91c745ef550 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:44.559503 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-943d23d5-9671-4051-85c5-a91c745ef550 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:44.560020 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-943d23d5-9671-4051-85c5-a91c745ef550 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:44.560878 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-943d23d5-9671-4051-85c5-a91c745ef550 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:44.561375 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-943d23d5-9671-4051-85c5-a91c745ef550 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:44.566345 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-6f3bf1ac-5c9d-4067-b9f6-b254a59d80b7 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5da5618e5a5640c28593881e6d144469', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bd5f2d3f10452aa7848bc1d229dfdd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:44.575740 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-6f3bf1ac-5c9d-4067-b9f6-b254a59d80b7 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871" status: 200 len: 1513 microversion: 2.1 time: 0.245265 Feb 19 02:31:44.576389 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 400/764] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:44 2021] GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871 => generated 1513 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:31:44.631608 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-9f4a3ec2-e084-4a19-8d5c-4645c1a8341d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:44.632571 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-9f4a3ec2-e084-4a19-8d5c-4645c1a8341d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:44.640640 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9f4a3ec2-e084-4a19-8d5c-4645c1a8341d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:44.641143 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9f4a3ec2-e084-4a19-8d5c-4645c1a8341d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:44.641988 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9f4a3ec2-e084-4a19-8d5c-4645c1a8341d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:44.642505 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9f4a3ec2-e084-4a19-8d5c-4645c1a8341d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:44.675376 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-943d23d5-9671-4051-85c5-a91c745ef550 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 14 microversion: 2.1 time: 0.135483 Feb 19 02:31:44.679018 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 365/765] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:31:44 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:31:44.780509 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-9f4a3ec2-e084-4a19-8d5c-4645c1a8341d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 35323 microversion: 2.20 time: 0.152850 Feb 19 02:31:44.782245 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 401/766] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:44 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 35323 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:31:44.929482 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-00ad5ae3-7871-4a37-86d3-1ee64f74c371 req-1b6a33b0-0311-4f26-86a5-88d0b5a0019c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f547266-6472-46d2-a651-03a6dab0b871", "name": "network-vif-deleted", "tag": "d1b61b95-00d7-4d6d-b713-66c941346701"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:44.931752 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:31:44.931752 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:31:44.942062 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-00ad5ae3-7871-4a37-86d3-1ee64f74c371 req-1b6a33b0-0311-4f26-86a5-88d0b5a0019c service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:44.943286 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-00ad5ae3-7871-4a37-86d3-1ee64f74c371 req-1b6a33b0-0311-4f26-86a5-88d0b5a0019c service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:44.961955 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-00ad5ae3-7871-4a37-86d3-1ee64f74c371 req-1b6a33b0-0311-4f26-86a5-88d0b5a0019c service nova] Creating event network-vif-deleted:d1b61b95-00d7-4d6d-b713-66c941346701 for instance 2f547266-6472-46d2-a651-03a6dab0b871 on hv-cinder-77642 Feb 19 02:31:44.967044 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-00ad5ae3-7871-4a37-86d3-1ee64f74c371 req-1b6a33b0-0311-4f26-86a5-88d0b5a0019c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042626 Feb 19 02:31:44.967753 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 366/767] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:31:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:31:45.596361 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-871c40e8-b3f8-46a8-8ec8-fca7ca40ead1 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:45.598132 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-871c40e8-b3f8-46a8-8ec8-fca7ca40ead1 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] [instance: 2f547266-6472-46d2-a651-03a6dab0b871] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:45.607874 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-871c40e8-b3f8-46a8-8ec8-fca7ca40ead1 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:45.608491 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-871c40e8-b3f8-46a8-8ec8-fca7ca40ead1 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:45.609346 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-871c40e8-b3f8-46a8-8ec8-fca7ca40ead1 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:45.609838 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-871c40e8-b3f8-46a8-8ec8-fca7ca40ead1 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:45.666392 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-871c40e8-b3f8-46a8-8ec8-fca7ca40ead1 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] HTTP exception thrown: Instance 2f547266-6472-46d2-a651-03a6dab0b871 could not be found. Feb 19 02:31:45.666956 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-871c40e8-b3f8-46a8-8ec8-fca7ca40ead1 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] Returning 404 to user: Instance 2f547266-6472-46d2-a651-03a6dab0b871 could not be found. {{(pid=98193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:31:45.667860 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-871c40e8-b3f8-46a8-8ec8-fca7ca40ead1 tempest-VolumesSnapshotTestJSON-1116563044 tempest-VolumesSnapshotTestJSON-1116563044-project] 10.222.0.44 "GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871" status: 404 len: 111 microversion: 2.1 time: 0.076739 Feb 19 02:31:45.668457 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 402/768] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:31:45 2021] GET /compute/v2.1/servers/2f547266-6472-46d2-a651-03a6dab0b871 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 02:31:45.688626 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-54367360-bd1e-42d5-af32-9a999177381c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:45.689759 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-54367360-bd1e-42d5-af32-9a999177381c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:45.700405 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-54367360-bd1e-42d5-af32-9a999177381c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:45.700908 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-54367360-bd1e-42d5-af32-9a999177381c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:45.701998 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-54367360-bd1e-42d5-af32-9a999177381c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:45.702509 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-54367360-bd1e-42d5-af32-9a999177381c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:45.793878 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-cfcfea54-c3f8-4a48-8d5f-d99432154203 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:45.794952 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-cfcfea54-c3f8-4a48-8d5f-d99432154203 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:45.803369 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cfcfea54-c3f8-4a48-8d5f-d99432154203 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:45.803876 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cfcfea54-c3f8-4a48-8d5f-d99432154203 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:45.804717 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cfcfea54-c3f8-4a48-8d5f-d99432154203 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:45.805208 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cfcfea54-c3f8-4a48-8d5f-d99432154203 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:45.813512 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-54367360-bd1e-42d5-af32-9a999177381c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 14 microversion: 2.1 time: 0.129108 Feb 19 02:31:45.814376 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 367/769] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:31:45 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:31:45.931304 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-cfcfea54-c3f8-4a48-8d5f-d99432154203 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 36525 microversion: 2.20 time: 0.141208 Feb 19 02:31:45.933018 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 403/770] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:45 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 36525 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 19 02:31:46.825685 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a1bc7d80-7f56-4b05-88a3-e37cc19ced34 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:46.827126 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a1bc7d80-7f56-4b05-88a3-e37cc19ced34 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:46.836310 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a1bc7d80-7f56-4b05-88a3-e37cc19ced34 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:46.836722 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a1bc7d80-7f56-4b05-88a3-e37cc19ced34 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:46.837555 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a1bc7d80-7f56-4b05-88a3-e37cc19ced34 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:46.838043 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a1bc7d80-7f56-4b05-88a3-e37cc19ced34 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:46.939738 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a1bc7d80-7f56-4b05-88a3-e37cc19ced34 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 14 microversion: 2.1 time: 0.118327 Feb 19 02:31:46.940436 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 368/771] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:31:46 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:31:46.945274 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-10289366-4018-421b-9054-70e2f3fda7a5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:46.946563 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-10289366-4018-421b-9054-70e2f3fda7a5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:46.956358 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-10289366-4018-421b-9054-70e2f3fda7a5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:46.956964 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-10289366-4018-421b-9054-70e2f3fda7a5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:46.957903 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-10289366-4018-421b-9054-70e2f3fda7a5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:46.959206 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-10289366-4018-421b-9054-70e2f3fda7a5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:47.075248 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-10289366-4018-421b-9054-70e2f3fda7a5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 37728 microversion: 2.20 time: 0.135653 Feb 19 02:31:47.077912 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 404/772] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:46 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 37728 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:31:47.953021 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ea4ba20d-20b7-454c-b28d-22abb0010615 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:47.954076 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ea4ba20d-20b7-454c-b28d-22abb0010615 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:47.963227 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ea4ba20d-20b7-454c-b28d-22abb0010615 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:47.963729 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ea4ba20d-20b7-454c-b28d-22abb0010615 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:47.964686 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ea4ba20d-20b7-454c-b28d-22abb0010615 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:47.965060 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ea4ba20d-20b7-454c-b28d-22abb0010615 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:48.088454 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e6099e9f-2d5b-46e6-90b9-454465d8966d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:48.089593 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e6099e9f-2d5b-46e6-90b9-454465d8966d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:48.098259 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e6099e9f-2d5b-46e6-90b9-454465d8966d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:48.099479 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e6099e9f-2d5b-46e6-90b9-454465d8966d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:48.100321 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e6099e9f-2d5b-46e6-90b9-454465d8966d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:48.100820 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e6099e9f-2d5b-46e6-90b9-454465d8966d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:50.754824 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ea4ba20d-20b7-454c-b28d-22abb0010615 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 14 microversion: 2.1 time: 2.806310 Feb 19 02:31:50.756893 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 369/773] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:31:47 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 14 bytes in 2809 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:31:50.775876 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e6099e9f-2d5b-46e6-90b9-454465d8966d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 38233 microversion: 2.20 time: 2.692315 Feb 19 02:31:50.778386 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 405/774] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:48 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 38233 bytes in 2694 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Feb 19 02:31:51.768352 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f9e3255f-59ac-4b6b-bd84-44f42ed2ba65 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:51.769562 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f9e3255f-59ac-4b6b-bd84-44f42ed2ba65 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:51.778916 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f9e3255f-59ac-4b6b-bd84-44f42ed2ba65 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:51.779432 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f9e3255f-59ac-4b6b-bd84-44f42ed2ba65 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:51.780281 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f9e3255f-59ac-4b6b-bd84-44f42ed2ba65 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:51.780771 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f9e3255f-59ac-4b6b-bd84-44f42ed2ba65 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:51.798039 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d4fc1480-11c4-4c3f-a022-e14d60751cf3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:51.799349 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d4fc1480-11c4-4c3f-a022-e14d60751cf3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:51.809396 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d4fc1480-11c4-4c3f-a022-e14d60751cf3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:51.809911 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d4fc1480-11c4-4c3f-a022-e14d60751cf3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:51.811085 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d4fc1480-11c4-4c3f-a022-e14d60751cf3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:51.811631 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d4fc1480-11c4-4c3f-a022-e14d60751cf3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:51.883416 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f9e3255f-59ac-4b6b-bd84-44f42ed2ba65 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 14 microversion: 2.1 time: 0.119435 Feb 19 02:31:51.884257 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 370/775] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:31:51 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:31:51.935859 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d4fc1480-11c4-4c3f-a022-e14d60751cf3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 38239 microversion: 2.20 time: 0.150917 Feb 19 02:31:51.936806 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 406/776] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:51 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 38239 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:31:52.895229 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-bda644e4-d610-4f5d-8f04-3edd000ebd00 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:52.896289 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-bda644e4-d610-4f5d-8f04-3edd000ebd00 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:52.905005 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bda644e4-d610-4f5d-8f04-3edd000ebd00 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:52.905517 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bda644e4-d610-4f5d-8f04-3edd000ebd00 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:52.906382 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bda644e4-d610-4f5d-8f04-3edd000ebd00 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:52.906868 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bda644e4-d610-4f5d-8f04-3edd000ebd00 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:52.950094 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f3f3b683-0376-4db1-8361-8e777789367e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:52.951305 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f3f3b683-0376-4db1-8361-8e777789367e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:52.960419 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f3f3b683-0376-4db1-8361-8e777789367e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:52.960936 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f3f3b683-0376-4db1-8361-8e777789367e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:52.961833 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f3f3b683-0376-4db1-8361-8e777789367e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:52.962325 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f3f3b683-0376-4db1-8361-8e777789367e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:53.023734 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-bda644e4-d610-4f5d-8f04-3edd000ebd00 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 5760 microversion: 2.1 time: 0.133121 Feb 19 02:31:53.027490 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 371/777] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:31:52 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 5760 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:31:53.084007 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f3f3b683-0376-4db1-8361-8e777789367e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 200 len: 38374 microversion: 2.20 time: 0.138395 Feb 19 02:31:53.084693 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 407/778] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:52 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 38374 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:31:53.097148 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-cea62b8f-6175-4d29-aa10-8c63cf9417c2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:53.097783 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-cea62b8f-6175-4d29-aa10-8c63cf9417c2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:53.106511 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cea62b8f-6175-4d29-aa10-8c63cf9417c2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:53.107007 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cea62b8f-6175-4d29-aa10-8c63cf9417c2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:53.107832 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cea62b8f-6175-4d29-aa10-8c63cf9417c2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:53.108319 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cea62b8f-6175-4d29-aa10-8c63cf9417c2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:53.168444 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-cea62b8f-6175-4d29-aa10-8c63cf9417c2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/ips" status: 200 len: 151 microversion: 2.20 time: 0.075773 Feb 19 02:31:53.168993 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 372/779] 10.222.0.44 () {60 vars in 1279 bytes} [Fri Feb 19 02:31:53 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/ips => generated 151 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:31:54.037629 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c279499f-9e89-4878-bdcf-db5536a42fcd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:54.038802 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c279499f-9e89-4878-bdcf-db5536a42fcd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:54.047417 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c279499f-9e89-4878-bdcf-db5536a42fcd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:54.047921 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c279499f-9e89-4878-bdcf-db5536a42fcd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:54.048758 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c279499f-9e89-4878-bdcf-db5536a42fcd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:54.049276 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c279499f-9e89-4878-bdcf-db5536a42fcd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:54.165026 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c279499f-9e89-4878-bdcf-db5536a42fcd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 12758 microversion: 2.1 time: 0.132662 Feb 19 02:31:54.165712 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 408/780] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:31:54 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 12758 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 19 02:31:55.177129 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-348b6390-e4a8-49ed-b8b6-513f76d43514 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:55.178390 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-348b6390-e4a8-49ed-b8b6-513f76d43514 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:55.186884 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-348b6390-e4a8-49ed-b8b6-513f76d43514 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:55.187389 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-348b6390-e4a8-49ed-b8b6-513f76d43514 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:55.188228 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-348b6390-e4a8-49ed-b8b6-513f76d43514 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:55.188719 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-348b6390-e4a8-49ed-b8b6-513f76d43514 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:55.310996 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-348b6390-e4a8-49ed-b8b6-513f76d43514 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 18498 microversion: 2.1 time: 0.137618 Feb 19 02:31:55.311682 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 373/781] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:31:55 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 18498 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:31:55.653899 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e7bf6b76-892b-444b-a60c-785545373ead tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:55.654602 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e7bf6b76-892b-444b-a60c-785545373ead tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:55.663509 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e7bf6b76-892b-444b-a60c-785545373ead tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:55.664009 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e7bf6b76-892b-444b-a60c-785545373ead tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:55.665017 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e7bf6b76-892b-444b-a60c-785545373ead tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:55.665508 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e7bf6b76-892b-444b-a60c-785545373ead tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:55.725657 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.objects.instance [None req-e7bf6b76-892b-444b-a60c-785545373ead tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lazy-loading 'flavor' on Instance uuid eb5c58f3-abb6-4bda-8928-db72606dcefd {{(pid=98193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 02:31:56.068358 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e7bf6b76-892b-444b-a60c-785545373ead tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 202 len: 0 microversion: 2.20 time: 0.418783 Feb 19 02:31:56.069305 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 409/782] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:31:55 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 19 02:31:56.078895 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5814b2d0-8460-42b5-937c-c631ed5787e3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:56.079654 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5814b2d0-8460-42b5-937c-c631ed5787e3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:56.088896 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5814b2d0-8460-42b5-937c-c631ed5787e3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:56.089414 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5814b2d0-8460-42b5-937c-c631ed5787e3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:56.090262 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5814b2d0-8460-42b5-937c-c631ed5787e3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:56.090795 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5814b2d0-8460-42b5-937c-c631ed5787e3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:56.310648 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5814b2d0-8460-42b5-937c-c631ed5787e3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:56.322170 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5814b2d0-8460-42b5-937c-c631ed5787e3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:56.323763 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5814b2d0-8460-42b5-937c-c631ed5787e3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:56.325147 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5814b2d0-8460-42b5-937c-c631ed5787e3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1722 microversion: 2.20 time: 0.250991 Feb 19 02:31:56.326122 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 374/783] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:31:56 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:31:56.326708 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a7596885-e338-49c5-a618-3b05b62d719c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:56.328112 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a7596885-e338-49c5-a618-3b05b62d719c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:56.337430 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a7596885-e338-49c5-a618-3b05b62d719c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:56.337939 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a7596885-e338-49c5-a618-3b05b62d719c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:56.338843 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a7596885-e338-49c5-a618-3b05b62d719c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:56.339338 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a7596885-e338-49c5-a618-3b05b62d719c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:56.455023 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a7596885-e338-49c5-a618-3b05b62d719c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 19342 microversion: 2.1 time: 0.136286 Feb 19 02:31:56.455836 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 410/784] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:31:56 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 19342 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:31:57.345361 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-78983f15-09da-484b-9366-072b6f89321f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:57.346075 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-78983f15-09da-484b-9366-072b6f89321f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:57.355227 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-78983f15-09da-484b-9366-072b6f89321f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:57.355737 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-78983f15-09da-484b-9366-072b6f89321f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:57.356564 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-78983f15-09da-484b-9366-072b6f89321f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:57.357054 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-78983f15-09da-484b-9366-072b6f89321f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:57.468228 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-3dea96e2-b899-4c14-8fb4-cecaa01a9785 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:31:57.469360 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-3dea96e2-b899-4c14-8fb4-cecaa01a9785 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:57.479550 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3dea96e2-b899-4c14-8fb4-cecaa01a9785 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:57.480055 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3dea96e2-b899-4c14-8fb4-cecaa01a9785 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:57.480895 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3dea96e2-b899-4c14-8fb4-cecaa01a9785 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:57.481363 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3dea96e2-b899-4c14-8fb4-cecaa01a9785 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:57.568659 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-78983f15-09da-484b-9366-072b6f89321f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:57.578263 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-78983f15-09da-484b-9366-072b6f89321f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:57.579923 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-78983f15-09da-484b-9366-072b6f89321f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:57.581137 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-78983f15-09da-484b-9366-072b6f89321f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1722 microversion: 2.20 time: 0.239831 Feb 19 02:31:57.581744 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 375/785] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:31:57 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:31:58.602221 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-fd8b11f7-e993-46a9-8f0b-d26322e04472 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:58.602936 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-fd8b11f7-e993-46a9-8f0b-d26322e04472 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:58.610799 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fd8b11f7-e993-46a9-8f0b-d26322e04472 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:58.611337 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fd8b11f7-e993-46a9-8f0b-d26322e04472 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:58.612156 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fd8b11f7-e993-46a9-8f0b-d26322e04472 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:58.612641 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fd8b11f7-e993-46a9-8f0b-d26322e04472 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:58.825746 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-fd8b11f7-e993-46a9-8f0b-d26322e04472 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:58.835238 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-fd8b11f7-e993-46a9-8f0b-d26322e04472 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:58.836834 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-fd8b11f7-e993-46a9-8f0b-d26322e04472 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:31:58.838033 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-fd8b11f7-e993-46a9-8f0b-d26322e04472 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1722 microversion: 2.20 time: 0.239984 Feb 19 02:31:58.838681 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 376/786] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:31:58 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 02:31:59.742716 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-3dea96e2-b899-4c14-8fb4-cecaa01a9785 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 24618 microversion: 2.1 time: 2.278765 Feb 19 02:31:59.743421 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 411/787] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:31:57 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 24618 bytes in 2281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 19 02:31:59.857569 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f10eeb08-3df0-4a6d-a7f6-ab17f3698476 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:31:59.858227 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f10eeb08-3df0-4a6d-a7f6-ab17f3698476 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:31:59.867201 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f10eeb08-3df0-4a6d-a7f6-ab17f3698476 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:59.867700 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f10eeb08-3df0-4a6d-a7f6-ab17f3698476 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:31:59.868518 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f10eeb08-3df0-4a6d-a7f6-ab17f3698476 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:31:59.868999 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f10eeb08-3df0-4a6d-a7f6-ab17f3698476 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:00.079215 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f10eeb08-3df0-4a6d-a7f6-ab17f3698476 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:00.089772 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f10eeb08-3df0-4a6d-a7f6-ab17f3698476 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:00.091354 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f10eeb08-3df0-4a6d-a7f6-ab17f3698476 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:00.092559 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f10eeb08-3df0-4a6d-a7f6-ab17f3698476 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1722 microversion: 2.20 time: 0.239054 Feb 19 02:32:00.093160 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 377/788] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:31:59 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:00.755673 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a043a031-842f-40f0-ad51-3006ce814a94 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:32:00.756857 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a043a031-842f-40f0-ad51-3006ce814a94 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:00.765740 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a043a031-842f-40f0-ad51-3006ce814a94 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:00.766244 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a043a031-842f-40f0-ad51-3006ce814a94 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:00.767117 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a043a031-842f-40f0-ad51-3006ce814a94 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:00.767608 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a043a031-842f-40f0-ad51-3006ce814a94 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:00.882402 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a043a031-842f-40f0-ad51-3006ce814a94 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 26058 microversion: 2.1 time: 0.131094 Feb 19 02:32:00.886661 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 412/789] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:32:00 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 26058 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:32:01.112992 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a72fe564-d264-4296-9297-b78e5077b345 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:01.113870 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a72fe564-d264-4296-9297-b78e5077b345 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:01.122570 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a72fe564-d264-4296-9297-b78e5077b345 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:01.123087 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a72fe564-d264-4296-9297-b78e5077b345 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:01.124044 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a72fe564-d264-4296-9297-b78e5077b345 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:01.124542 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a72fe564-d264-4296-9297-b78e5077b345 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:01.355819 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a72fe564-d264-4296-9297-b78e5077b345 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:01.366583 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a72fe564-d264-4296-9297-b78e5077b345 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:01.368389 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a72fe564-d264-4296-9297-b78e5077b345 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:01.369802 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a72fe564-d264-4296-9297-b78e5077b345 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1722 microversion: 2.20 time: 0.261118 Feb 19 02:32:01.370607 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 378/790] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:01 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:01.895614 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-56f1a708-e376-4272-8e45-c0e178a15066 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:32:01.896748 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-56f1a708-e376-4272-8e45-c0e178a15066 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:01.905459 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-56f1a708-e376-4272-8e45-c0e178a15066 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:01.905968 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-56f1a708-e376-4272-8e45-c0e178a15066 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:01.906819 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-56f1a708-e376-4272-8e45-c0e178a15066 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:01.907302 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-56f1a708-e376-4272-8e45-c0e178a15066 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:02.025952 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-56f1a708-e376-4272-8e45-c0e178a15066 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 27136 microversion: 2.1 time: 0.134803 Feb 19 02:32:02.026663 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 413/791] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:32:01 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 27136 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:32:02.389926 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-352f0e2b-5fe0-4610-a7b2-f491a21c7a22 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:02.390620 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-352f0e2b-5fe0-4610-a7b2-f491a21c7a22 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:02.398566 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-352f0e2b-5fe0-4610-a7b2-f491a21c7a22 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:02.399063 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-352f0e2b-5fe0-4610-a7b2-f491a21c7a22 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:02.399890 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-352f0e2b-5fe0-4610-a7b2-f491a21c7a22 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:02.400375 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-352f0e2b-5fe0-4610-a7b2-f491a21c7a22 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:02.622032 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-352f0e2b-5fe0-4610-a7b2-f491a21c7a22 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:02.632229 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-352f0e2b-5fe0-4610-a7b2-f491a21c7a22 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:02.633880 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-352f0e2b-5fe0-4610-a7b2-f491a21c7a22 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:02.635217 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-352f0e2b-5fe0-4610-a7b2-f491a21c7a22 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1722 microversion: 2.20 time: 0.249355 Feb 19 02:32:02.635945 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 379/792] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:02 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:03.038765 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-80b89bbb-17e1-4089-b3dd-862412f35abb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:32:03.039990 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-80b89bbb-17e1-4089-b3dd-862412f35abb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:03.048528 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-80b89bbb-17e1-4089-b3dd-862412f35abb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:03.049043 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-80b89bbb-17e1-4089-b3dd-862412f35abb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:03.049881 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-80b89bbb-17e1-4089-b3dd-862412f35abb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:03.050401 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-80b89bbb-17e1-4089-b3dd-862412f35abb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:03.162501 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-80b89bbb-17e1-4089-b3dd-862412f35abb tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 27831 microversion: 2.1 time: 0.128437 Feb 19 02:32:03.163187 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 414/793] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:32:03 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 27831 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:32:03.655618 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-06eaa98c-91c0-4cbf-9c43-5451a53113fa tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:03.656278 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-06eaa98c-91c0-4cbf-9c43-5451a53113fa tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:03.664826 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-06eaa98c-91c0-4cbf-9c43-5451a53113fa tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:03.665369 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-06eaa98c-91c0-4cbf-9c43-5451a53113fa tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:03.666195 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-06eaa98c-91c0-4cbf-9c43-5451a53113fa tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:03.666708 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-06eaa98c-91c0-4cbf-9c43-5451a53113fa tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:03.882424 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-06eaa98c-91c0-4cbf-9c43-5451a53113fa tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:03.891903 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-06eaa98c-91c0-4cbf-9c43-5451a53113fa tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:03.893819 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-06eaa98c-91c0-4cbf-9c43-5451a53113fa tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:03.895136 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-06eaa98c-91c0-4cbf-9c43-5451a53113fa tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1722 microversion: 2.20 time: 0.243520 Feb 19 02:32:03.895753 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 380/794] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:03 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:04.175708 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4d4ef64a-3e33-4b60-abf9-de27b4c3fa93 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:32:04.176774 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-4d4ef64a-3e33-4b60-abf9-de27b4c3fa93 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:04.185513 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4d4ef64a-3e33-4b60-abf9-de27b4c3fa93 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:04.186072 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4d4ef64a-3e33-4b60-abf9-de27b4c3fa93 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:04.186901 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4d4ef64a-3e33-4b60-abf9-de27b4c3fa93 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:04.187402 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4d4ef64a-3e33-4b60-abf9-de27b4c3fa93 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:04.306675 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-4d4ef64a-3e33-4b60-abf9-de27b4c3fa93 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 28201 microversion: 2.1 time: 0.135334 Feb 19 02:32:04.307389 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 415/795] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:32:04 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 28201 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:32:04.915947 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c7c54db9-1fe7-412d-9c9f-2fc09839a99e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:04.916610 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c7c54db9-1fe7-412d-9c9f-2fc09839a99e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:04.924721 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c7c54db9-1fe7-412d-9c9f-2fc09839a99e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:04.925221 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c7c54db9-1fe7-412d-9c9f-2fc09839a99e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:04.926050 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c7c54db9-1fe7-412d-9c9f-2fc09839a99e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:04.927070 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c7c54db9-1fe7-412d-9c9f-2fc09839a99e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:05.148917 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c7c54db9-1fe7-412d-9c9f-2fc09839a99e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:05.161270 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c7c54db9-1fe7-412d-9c9f-2fc09839a99e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:05.162922 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c7c54db9-1fe7-412d-9c9f-2fc09839a99e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:05.164166 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c7c54db9-1fe7-412d-9c9f-2fc09839a99e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1722 microversion: 2.20 time: 0.252341 Feb 19 02:32:05.164957 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 381/796] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:04 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:05.320365 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-99647ded-3ad4-4b4f-87b2-f434b9c78185 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:32:05.321491 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-99647ded-3ad4-4b4f-87b2-f434b9c78185 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:05.330142 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-99647ded-3ad4-4b4f-87b2-f434b9c78185 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:05.330693 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-99647ded-3ad4-4b4f-87b2-f434b9c78185 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:05.331525 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-99647ded-3ad4-4b4f-87b2-f434b9c78185 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:05.332012 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-99647ded-3ad4-4b4f-87b2-f434b9c78185 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:05.446324 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-99647ded-3ad4-4b4f-87b2-f434b9c78185 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 28201 microversion: 2.1 time: 0.130829 Feb 19 02:32:05.447315 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 416/797] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:32:05 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 28201 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:32:06.183833 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8c738ce8-8af9-4b44-8b0f-6e043ba80dfa tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:06.184597 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8c738ce8-8af9-4b44-8b0f-6e043ba80dfa tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:06.192614 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8c738ce8-8af9-4b44-8b0f-6e043ba80dfa tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:06.193127 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8c738ce8-8af9-4b44-8b0f-6e043ba80dfa tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:06.193975 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8c738ce8-8af9-4b44-8b0f-6e043ba80dfa tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:06.194497 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8c738ce8-8af9-4b44-8b0f-6e043ba80dfa tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:06.417349 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8c738ce8-8af9-4b44-8b0f-6e043ba80dfa tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:06.428385 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8c738ce8-8af9-4b44-8b0f-6e043ba80dfa tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:06.430291 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8c738ce8-8af9-4b44-8b0f-6e043ba80dfa tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:06.431585 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8c738ce8-8af9-4b44-8b0f-6e043ba80dfa tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1722 microversion: 2.20 time: 0.251840 Feb 19 02:32:06.432193 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 382/798] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:06 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:06.459787 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-760798ca-3db5-4ede-9d83-d2ec3b1bfd5e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:32:06.460923 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-760798ca-3db5-4ede-9d83-d2ec3b1bfd5e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:06.469692 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-760798ca-3db5-4ede-9d83-d2ec3b1bfd5e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:06.470194 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-760798ca-3db5-4ede-9d83-d2ec3b1bfd5e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:06.471094 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-760798ca-3db5-4ede-9d83-d2ec3b1bfd5e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:06.471584 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-760798ca-3db5-4ede-9d83-d2ec3b1bfd5e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:06.599927 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-760798ca-3db5-4ede-9d83-d2ec3b1bfd5e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 28492 microversion: 2.1 time: 0.145098 Feb 19 02:32:06.600700 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 417/799] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:32:06 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 28492 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:32:07.452669 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-246299b0-aeaa-49f1-8a0f-5d73f46321fc tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:07.453342 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-246299b0-aeaa-49f1-8a0f-5d73f46321fc tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:07.461356 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-246299b0-aeaa-49f1-8a0f-5d73f46321fc tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:07.461866 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-246299b0-aeaa-49f1-8a0f-5d73f46321fc tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:07.462737 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-246299b0-aeaa-49f1-8a0f-5d73f46321fc tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:07.463233 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-246299b0-aeaa-49f1-8a0f-5d73f46321fc tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:07.617312 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e6c9f120-7bd4-45c7-8a88-803094afd420 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:32:07.619893 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e6c9f120-7bd4-45c7-8a88-803094afd420 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:07.630818 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e6c9f120-7bd4-45c7-8a88-803094afd420 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:07.630818 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e6c9f120-7bd4-45c7-8a88-803094afd420 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:07.631338 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e6c9f120-7bd4-45c7-8a88-803094afd420 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:07.631811 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e6c9f120-7bd4-45c7-8a88-803094afd420 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:07.752586 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e6c9f120-7bd4-45c7-8a88-803094afd420 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 28660 microversion: 2.1 time: 0.143460 Feb 19 02:32:07.754632 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 418/800] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:32:07 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 28660 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 19 02:32:07.897778 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-246299b0-aeaa-49f1-8a0f-5d73f46321fc tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:07.907375 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-246299b0-aeaa-49f1-8a0f-5d73f46321fc tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:07.908947 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-246299b0-aeaa-49f1-8a0f-5d73f46321fc tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:07.910176 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-246299b0-aeaa-49f1-8a0f-5d73f46321fc tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1722 microversion: 2.20 time: 0.462835 Feb 19 02:32:07.910881 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 383/801] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:07 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1722 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:08.766796 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f3caaa89-247b-4d15-ad43-a2d3c9145381 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:32:08.768092 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f3caaa89-247b-4d15-ad43-a2d3c9145381 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:08.777646 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f3caaa89-247b-4d15-ad43-a2d3c9145381 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:08.778278 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f3caaa89-247b-4d15-ad43-a2d3c9145381 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:08.779256 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f3caaa89-247b-4d15-ad43-a2d3c9145381 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:08.779817 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f3caaa89-247b-4d15-ad43-a2d3c9145381 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:08.906796 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f3caaa89-247b-4d15-ad43-a2d3c9145381 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 28660 microversion: 2.1 time: 0.143387 Feb 19 02:32:08.907810 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 419/802] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:32:08 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 28660 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:32:08.930442 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1d353fc5-0883-4f26-9d19-cb1bcc346aba tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:08.931110 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1d353fc5-0883-4f26-9d19-cb1bcc346aba tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:08.950249 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1d353fc5-0883-4f26-9d19-cb1bcc346aba tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:08.950777 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1d353fc5-0883-4f26-9d19-cb1bcc346aba tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:08.951623 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1d353fc5-0883-4f26-9d19-cb1bcc346aba tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:08.952380 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1d353fc5-0883-4f26-9d19-cb1bcc346aba tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:09.445739 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-1d353fc5-0883-4f26-9d19-cb1bcc346aba tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:09.455933 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-1d353fc5-0883-4f26-9d19-cb1bcc346aba tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:09.458212 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-1d353fc5-0883-4f26-9d19-cb1bcc346aba tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:09.459482 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1d353fc5-0883-4f26-9d19-cb1bcc346aba tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1722 microversion: 2.20 time: 0.533241 Feb 19 02:32:09.460145 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 384/803] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:08 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1722 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:09.925701 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-00dc987d-4b1f-43e8-b054-597519daa902 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:32:09.926926 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-00dc987d-4b1f-43e8-b054-597519daa902 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:09.945534 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-00dc987d-4b1f-43e8-b054-597519daa902 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:09.946480 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-00dc987d-4b1f-43e8-b054-597519daa902 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:09.947468 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-00dc987d-4b1f-43e8-b054-597519daa902 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:09.948074 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-00dc987d-4b1f-43e8-b054-597519daa902 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:10.054643 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-00dc987d-4b1f-43e8-b054-597519daa902 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 28660 microversion: 2.1 time: 0.138749 Feb 19 02:32:10.055673 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 420/804] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:32:09 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 28660 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:32:10.480128 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-9a7e129c-88dd-4b0f-b3a9-7305abc5b55d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:10.480814 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-9a7e129c-88dd-4b0f-b3a9-7305abc5b55d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:10.492500 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a7e129c-88dd-4b0f-b3a9-7305abc5b55d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:10.492990 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a7e129c-88dd-4b0f-b3a9-7305abc5b55d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:10.493800 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a7e129c-88dd-4b0f-b3a9-7305abc5b55d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:10.494299 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a7e129c-88dd-4b0f-b3a9-7305abc5b55d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:10.965485 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9a7e129c-88dd-4b0f-b3a9-7305abc5b55d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:10.975853 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9a7e129c-88dd-4b0f-b3a9-7305abc5b55d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:10.977490 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9a7e129c-88dd-4b0f-b3a9-7305abc5b55d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:10.978887 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-9a7e129c-88dd-4b0f-b3a9-7305abc5b55d tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1722 microversion: 2.20 time: 0.503304 Feb 19 02:32:10.979510 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 385/805] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:10 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1722 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:11.068405 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ee6491bf-869f-4a4b-820a-9761f58f840b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:32:11.069594 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ee6491bf-869f-4a4b-820a-9761f58f840b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:11.078447 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ee6491bf-869f-4a4b-820a-9761f58f840b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:11.078966 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ee6491bf-869f-4a4b-820a-9761f58f840b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:11.079818 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ee6491bf-869f-4a4b-820a-9761f58f840b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:11.080309 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ee6491bf-869f-4a4b-820a-9761f58f840b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:11.199797 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ee6491bf-869f-4a4b-820a-9761f58f840b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 29403 microversion: 2.1 time: 0.135686 Feb 19 02:32:11.204578 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 421/806] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:32:11 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 29403 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:32:12.004271 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4dca0e6a-b6f3-41e4-a8a6-d515a4a32f7b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:12.005287 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-4dca0e6a-b6f3-41e4-a8a6-d515a4a32f7b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:12.022569 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4dca0e6a-b6f3-41e4-a8a6-d515a4a32f7b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:12.024969 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4dca0e6a-b6f3-41e4-a8a6-d515a4a32f7b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:12.026147 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4dca0e6a-b6f3-41e4-a8a6-d515a4a32f7b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:12.026820 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4dca0e6a-b6f3-41e4-a8a6-d515a4a32f7b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:12.216089 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c95c4081-d0dd-4c0c-9549-dda5d3d9e559 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:32:12.217191 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c95c4081-d0dd-4c0c-9549-dda5d3d9e559 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:12.227837 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c95c4081-d0dd-4c0c-9549-dda5d3d9e559 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:12.228619 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c95c4081-d0dd-4c0c-9549-dda5d3d9e559 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:12.230177 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c95c4081-d0dd-4c0c-9549-dda5d3d9e559 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:12.231233 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c95c4081-d0dd-4c0c-9549-dda5d3d9e559 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:12.290218 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-4dca0e6a-b6f3-41e4-a8a6-d515a4a32f7b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:12.301601 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-4dca0e6a-b6f3-41e4-a8a6-d515a4a32f7b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:12.303260 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-4dca0e6a-b6f3-41e4-a8a6-d515a4a32f7b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:12.304518 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-4dca0e6a-b6f3-41e4-a8a6-d515a4a32f7b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1743 microversion: 2.20 time: 0.307282 Feb 19 02:32:12.305327 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 386/807] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:11 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1743 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:12.424976 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c95c4081-d0dd-4c0c-9549-dda5d3d9e559 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 31474 microversion: 2.1 time: 0.214487 Feb 19 02:32:12.426503 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 422/808] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:32:12 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 31474 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:32:13.324867 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b3aed5c3-894c-4efb-9da9-172fe051b386 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:13.326105 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b3aed5c3-894c-4efb-9da9-172fe051b386 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:13.334497 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b3aed5c3-894c-4efb-9da9-172fe051b386 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:13.335480 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b3aed5c3-894c-4efb-9da9-172fe051b386 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:13.336484 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b3aed5c3-894c-4efb-9da9-172fe051b386 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:13.337126 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b3aed5c3-894c-4efb-9da9-172fe051b386 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:13.438390 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b4864997-4bf0-4ec6-a9a1-ab747823ede6 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:32:13.439815 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b4864997-4bf0-4ec6-a9a1-ab747823ede6 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:13.449311 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b4864997-4bf0-4ec6-a9a1-ab747823ede6 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:13.450090 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b4864997-4bf0-4ec6-a9a1-ab747823ede6 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:13.451121 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b4864997-4bf0-4ec6-a9a1-ab747823ede6 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:13.451762 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b4864997-4bf0-4ec6-a9a1-ab747823ede6 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:13.594344 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b4864997-4bf0-4ec6-a9a1-ab747823ede6 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 32762 microversion: 2.1 time: 0.159817 Feb 19 02:32:13.595401 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 423/809] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:32:13 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 32762 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:32:13.981522 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b3aed5c3-894c-4efb-9da9-172fe051b386 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:13.995724 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b3aed5c3-894c-4efb-9da9-172fe051b386 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:13.999773 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b3aed5c3-894c-4efb-9da9-172fe051b386 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:14.004033 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b3aed5c3-894c-4efb-9da9-172fe051b386 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1743 microversion: 2.20 time: 0.683142 Feb 19 02:32:14.018661 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 387/810] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:13 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1743 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:14.608687 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-3b064c53-f827-44c7-aa42-03cd9bee154f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:32:14.609751 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-3b064c53-f827-44c7-aa42-03cd9bee154f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:14.634286 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3b064c53-f827-44c7-aa42-03cd9bee154f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:14.634901 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3b064c53-f827-44c7-aa42-03cd9bee154f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:14.635711 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3b064c53-f827-44c7-aa42-03cd9bee154f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:14.636209 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3b064c53-f827-44c7-aa42-03cd9bee154f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:14.810425 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-3b064c53-f827-44c7-aa42-03cd9bee154f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 34203 microversion: 2.1 time: 0.206075 Feb 19 02:32:14.811155 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 424/811] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:32:14 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 34203 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:32:15.029944 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8b768555-b9e5-4688-a92e-c9b07750d7d0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:15.030873 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8b768555-b9e5-4688-a92e-c9b07750d7d0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:15.046739 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8b768555-b9e5-4688-a92e-c9b07750d7d0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:15.048318 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8b768555-b9e5-4688-a92e-c9b07750d7d0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:15.050127 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8b768555-b9e5-4688-a92e-c9b07750d7d0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:15.051476 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8b768555-b9e5-4688-a92e-c9b07750d7d0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:15.421913 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8b768555-b9e5-4688-a92e-c9b07750d7d0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:15.435546 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8b768555-b9e5-4688-a92e-c9b07750d7d0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:15.439257 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8b768555-b9e5-4688-a92e-c9b07750d7d0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:15.441501 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8b768555-b9e5-4688-a92e-c9b07750d7d0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1738 microversion: 2.20 time: 0.420369 Feb 19 02:32:15.444810 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 388/812] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:15 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1738 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:15.825308 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-3f572fee-7a76-4f16-992e-fcfdd0bb70fd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:32:15.826484 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-3f572fee-7a76-4f16-992e-fcfdd0bb70fd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:15.848887 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3f572fee-7a76-4f16-992e-fcfdd0bb70fd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:15.849710 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3f572fee-7a76-4f16-992e-fcfdd0bb70fd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:15.850807 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3f572fee-7a76-4f16-992e-fcfdd0bb70fd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:15.851483 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3f572fee-7a76-4f16-992e-fcfdd0bb70fd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:16.122880 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-3f572fee-7a76-4f16-992e-fcfdd0bb70fd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 35308 microversion: 2.1 time: 0.301964 Feb 19 02:32:16.124749 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 425/813] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:32:15 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 35308 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:32:16.465749 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ddd1bedb-7fcd-4925-8d7c-2508ff7b04c7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:16.466500 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ddd1bedb-7fcd-4925-8d7c-2508ff7b04c7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:16.475623 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ddd1bedb-7fcd-4925-8d7c-2508ff7b04c7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:16.476565 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ddd1bedb-7fcd-4925-8d7c-2508ff7b04c7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:16.477632 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ddd1bedb-7fcd-4925-8d7c-2508ff7b04c7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:16.478309 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ddd1bedb-7fcd-4925-8d7c-2508ff7b04c7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:16.791808 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ddd1bedb-7fcd-4925-8d7c-2508ff7b04c7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:16.819907 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ddd1bedb-7fcd-4925-8d7c-2508ff7b04c7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:16.823750 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ddd1bedb-7fcd-4925-8d7c-2508ff7b04c7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:16.825071 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ddd1bedb-7fcd-4925-8d7c-2508ff7b04c7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1738 microversion: 2.20 time: 0.363942 Feb 19 02:32:16.825676 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 389/814] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:16 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1738 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:17.138311 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-bdc77831-89e4-475c-b8ff-68bea6bdc3e6 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:32:17.139499 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-bdc77831-89e4-475c-b8ff-68bea6bdc3e6 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:17.164516 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bdc77831-89e4-475c-b8ff-68bea6bdc3e6 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:17.165478 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bdc77831-89e4-475c-b8ff-68bea6bdc3e6 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:17.166874 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bdc77831-89e4-475c-b8ff-68bea6bdc3e6 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:17.167733 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bdc77831-89e4-475c-b8ff-68bea6bdc3e6 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:17.322376 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-bdc77831-89e4-475c-b8ff-68bea6bdc3e6 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 36715 microversion: 2.1 time: 0.189827 Feb 19 02:32:17.323841 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 426/815] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:32:17 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 36715 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:32:17.845615 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e0f2686b-3233-4ed1-9b43-3e013e0d1252 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:17.846862 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e0f2686b-3233-4ed1-9b43-3e013e0d1252 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:17.868349 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e0f2686b-3233-4ed1-9b43-3e013e0d1252 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:17.869111 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e0f2686b-3233-4ed1-9b43-3e013e0d1252 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:17.870138 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e0f2686b-3233-4ed1-9b43-3e013e0d1252 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:17.870824 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e0f2686b-3233-4ed1-9b43-3e013e0d1252 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:18.265930 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e0f2686b-3233-4ed1-9b43-3e013e0d1252 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:18.278003 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e0f2686b-3233-4ed1-9b43-3e013e0d1252 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:18.297339 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e0f2686b-3233-4ed1-9b43-3e013e0d1252 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:18.306645 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e0f2686b-3233-4ed1-9b43-3e013e0d1252 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1738 microversion: 2.20 time: 0.465040 Feb 19 02:32:18.307477 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 390/816] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:17 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1738 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:18.337767 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-cdb33e02-c84b-4e5a-a81e-4348b9cc45ef tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:32:18.341580 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-cdb33e02-c84b-4e5a-a81e-4348b9cc45ef tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:18.362399 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cdb33e02-c84b-4e5a-a81e-4348b9cc45ef tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:18.363151 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cdb33e02-c84b-4e5a-a81e-4348b9cc45ef tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:18.364746 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cdb33e02-c84b-4e5a-a81e-4348b9cc45ef tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:18.365394 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cdb33e02-c84b-4e5a-a81e-4348b9cc45ef tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:18.545771 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-cdb33e02-c84b-4e5a-a81e-4348b9cc45ef tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 38182 microversion: 2.1 time: 0.209052 Feb 19 02:32:18.545771 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 427/817] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:32:18 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 38182 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:32:19.330541 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-80b8ef6b-082b-43ff-9f8d-163f5e2602e2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:19.331876 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-80b8ef6b-082b-43ff-9f8d-163f5e2602e2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:19.350211 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-80b8ef6b-082b-43ff-9f8d-163f5e2602e2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:19.350774 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-80b8ef6b-082b-43ff-9f8d-163f5e2602e2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:19.351630 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-80b8ef6b-082b-43ff-9f8d-163f5e2602e2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:19.352126 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-80b8ef6b-082b-43ff-9f8d-163f5e2602e2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:19.555702 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-bab09d89-cd01-4db3-bdae-843f586099ee tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:32:19.556765 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-bab09d89-cd01-4db3-bdae-843f586099ee tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:19.584302 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bab09d89-cd01-4db3-bdae-843f586099ee tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:19.584807 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bab09d89-cd01-4db3-bdae-843f586099ee tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:19.585650 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bab09d89-cd01-4db3-bdae-843f586099ee tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:19.586144 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bab09d89-cd01-4db3-bdae-843f586099ee tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:19.734664 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-bab09d89-cd01-4db3-bdae-843f586099ee tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 38182 microversion: 2.1 time: 0.183492 Feb 19 02:32:19.735276 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 428/818] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:32:19 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 38182 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:32:19.755249 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-80b8ef6b-082b-43ff-9f8d-163f5e2602e2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:19.775425 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-80b8ef6b-082b-43ff-9f8d-163f5e2602e2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:19.780032 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-80b8ef6b-082b-43ff-9f8d-163f5e2602e2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:19.786487 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-80b8ef6b-082b-43ff-9f8d-163f5e2602e2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1738 microversion: 2.20 time: 0.460072 Feb 19 02:32:19.787646 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 391/819] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:19 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1738 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:20.748679 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e94693fd-1364-4cb1-8376-ab69298925d0 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:32:20.749824 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e94693fd-1364-4cb1-8376-ab69298925d0 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:20.769241 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e94693fd-1364-4cb1-8376-ab69298925d0 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:20.770919 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e94693fd-1364-4cb1-8376-ab69298925d0 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:20.771969 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e94693fd-1364-4cb1-8376-ab69298925d0 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:20.780871 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e94693fd-1364-4cb1-8376-ab69298925d0 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:20.806766 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b9da3d80-999f-4885-b8ab-1fb45080f379 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:20.807650 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b9da3d80-999f-4885-b8ab-1fb45080f379 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:20.830812 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b9da3d80-999f-4885-b8ab-1fb45080f379 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:20.831566 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b9da3d80-999f-4885-b8ab-1fb45080f379 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:20.835288 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b9da3d80-999f-4885-b8ab-1fb45080f379 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:20.838335 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b9da3d80-999f-4885-b8ab-1fb45080f379 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:20.968235 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e94693fd-1364-4cb1-8376-ab69298925d0 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 38182 microversion: 2.1 time: 0.223910 Feb 19 02:32:20.972719 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 429/820] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:32:20 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 38182 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:32:21.286451 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b9da3d80-999f-4885-b8ab-1fb45080f379 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:21.304590 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b9da3d80-999f-4885-b8ab-1fb45080f379 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:21.306459 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b9da3d80-999f-4885-b8ab-1fb45080f379 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:21.309945 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b9da3d80-999f-4885-b8ab-1fb45080f379 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1738 microversion: 2.20 time: 0.507199 Feb 19 02:32:21.310975 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 392/821] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:20 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1738 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:21.981159 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ee51bc04-1740-4c1b-ba50-f8a018e65e6d tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:32:21.983216 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ee51bc04-1740-4c1b-ba50-f8a018e65e6d tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:21.994393 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ee51bc04-1740-4c1b-ba50-f8a018e65e6d tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:21.995260 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ee51bc04-1740-4c1b-ba50-f8a018e65e6d tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:21.996335 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ee51bc04-1740-4c1b-ba50-f8a018e65e6d tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:21.997042 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ee51bc04-1740-4c1b-ba50-f8a018e65e6d tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:22.121235 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ee51bc04-1740-4c1b-ba50-f8a018e65e6d tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 38182 microversion: 2.1 time: 0.141561 Feb 19 02:32:22.127520 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 430/822] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:32:21 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 38182 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:32:22.330661 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7a167884-4348-43af-9d9d-278540402fb2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:22.331238 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7a167884-4348-43af-9d9d-278540402fb2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:22.341346 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7a167884-4348-43af-9d9d-278540402fb2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:22.342071 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7a167884-4348-43af-9d9d-278540402fb2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:22.343222 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7a167884-4348-43af-9d9d-278540402fb2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:22.343874 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7a167884-4348-43af-9d9d-278540402fb2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:22.632323 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7a167884-4348-43af-9d9d-278540402fb2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:22.643761 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7a167884-4348-43af-9d9d-278540402fb2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:22.646229 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7a167884-4348-43af-9d9d-278540402fb2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:22.647846 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7a167884-4348-43af-9d9d-278540402fb2 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1738 microversion: 2.20 time: 0.322539 Feb 19 02:32:22.648476 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 393/823] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:22 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1738 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:23.137800 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-87347c33-7abf-450a-b181-7cfe4fc5dec5 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:32:23.144406 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-87347c33-7abf-450a-b181-7cfe4fc5dec5 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:23.153989 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-87347c33-7abf-450a-b181-7cfe4fc5dec5 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:23.154906 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-87347c33-7abf-450a-b181-7cfe4fc5dec5 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:23.155979 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-87347c33-7abf-450a-b181-7cfe4fc5dec5 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:23.156686 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-87347c33-7abf-450a-b181-7cfe4fc5dec5 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:23.309002 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-87347c33-7abf-450a-b181-7cfe4fc5dec5 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action" status: 200 len: 38311 microversion: 2.1 time: 0.175723 Feb 19 02:32:23.310708 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 431/824] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:32:23 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/action => generated 38311 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:32:23.322909 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1e291c4c-08f1-43a4-9f9c-85e0acf552c9 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:23.323837 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1e291c4c-08f1-43a4-9f9c-85e0acf552c9 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:23.345678 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1e291c4c-08f1-43a4-9f9c-85e0acf552c9 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:23.346484 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1e291c4c-08f1-43a4-9f9c-85e0acf552c9 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:23.352226 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1e291c4c-08f1-43a4-9f9c-85e0acf552c9 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:23.355411 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1e291c4c-08f1-43a4-9f9c-85e0acf552c9 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:23.503928 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1e291c4c-08f1-43a4-9f9c-85e0acf552c9 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/ips" status: 200 len: 144 microversion: 2.1 time: 0.187144 Feb 19 02:32:23.504793 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 394/825] 10.222.0.44 () {58 vars in 1238 bytes} [Fri Feb 19 02:32:23 2021] GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/ips => generated 144 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:32:23.669085 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d1fb73a8-73c3-4490-a92b-807f5e7ef7a5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:23.669767 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d1fb73a8-73c3-4490-a92b-807f5e7ef7a5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:23.689136 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d1fb73a8-73c3-4490-a92b-807f5e7ef7a5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:23.689639 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d1fb73a8-73c3-4490-a92b-807f5e7ef7a5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:23.690517 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d1fb73a8-73c3-4490-a92b-807f5e7ef7a5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:23.691010 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d1fb73a8-73c3-4490-a92b-807f5e7ef7a5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:24.324583 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-d1fb73a8-73c3-4490-a92b-807f5e7ef7a5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:24.343021 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-d1fb73a8-73c3-4490-a92b-807f5e7ef7a5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:24.345112 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-d1fb73a8-73c3-4490-a92b-807f5e7ef7a5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:24.347135 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d1fb73a8-73c3-4490-a92b-807f5e7ef7a5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1738 microversion: 2.20 time: 0.682254 Feb 19 02:32:24.348922 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 432/826] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:23 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1738 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:25.372447 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c4e199c4-5f4c-43fe-b688-38b92729c6db tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:25.374332 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c4e199c4-5f4c-43fe-b688-38b92729c6db tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:25.389529 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c4e199c4-5f4c-43fe-b688-38b92729c6db tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:25.395527 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c4e199c4-5f4c-43fe-b688-38b92729c6db tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:25.396737 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c4e199c4-5f4c-43fe-b688-38b92729c6db tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:25.401947 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c4e199c4-5f4c-43fe-b688-38b92729c6db tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:25.806488 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b1a15699-1fec-4f56-8dce-43a65065212b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13cfcc28-aeb8-4a69-9cec-6043c900a4f0"}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:32:25.823560 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b1a15699-1fec-4f56-8dce-43a65065212b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:25.828918 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c4e199c4-5f4c-43fe-b688-38b92729c6db tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:25.846642 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b1a15699-1fec-4f56-8dce-43a65065212b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:25.847482 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b1a15699-1fec-4f56-8dce-43a65065212b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:25.849344 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b1a15699-1fec-4f56-8dce-43a65065212b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:25.850054 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b1a15699-1fec-4f56-8dce-43a65065212b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:25.858735 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c4e199c4-5f4c-43fe-b688-38b92729c6db tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:25.860317 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c4e199c4-5f4c-43fe-b688-38b92729c6db tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:25.861561 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c4e199c4-5f4c-43fe-b688-38b92729c6db tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1738 microversion: 2.20 time: 0.494617 Feb 19 02:32:25.882088 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 395/827] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:25 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1738 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:26.532427 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b1a15699-1fec-4f56-8dce-43a65065212b tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.730128 Feb 19 02:32:26.533408 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 433/828] 10.222.0.44 () {60 vars in 1313 bytes} [Fri Feb 19 02:32:25 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/os-volume_attachments => generated 194 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:32:26.889383 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-15139624-cc1a-447b-8b23-7e653b0c73f3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:26.890257 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-15139624-cc1a-447b-8b23-7e653b0c73f3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:26.900548 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-15139624-cc1a-447b-8b23-7e653b0c73f3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:26.901404 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-15139624-cc1a-447b-8b23-7e653b0c73f3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:26.902701 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-15139624-cc1a-447b-8b23-7e653b0c73f3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:26.903408 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-15139624-cc1a-447b-8b23-7e653b0c73f3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:27.245446 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-15139624-cc1a-447b-8b23-7e653b0c73f3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:27.255892 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-15139624-cc1a-447b-8b23-7e653b0c73f3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:27.257637 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-15139624-cc1a-447b-8b23-7e653b0c73f3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:27.258907 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-15139624-cc1a-447b-8b23-7e653b0c73f3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1738 microversion: 2.20 time: 0.373600 Feb 19 02:32:27.259700 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 396/829] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:26 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1738 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:28.280269 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f1f2c5ba-d5db-4f94-91e2-89c5c1a373f5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:28.282409 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f1f2c5ba-d5db-4f94-91e2-89c5c1a373f5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:28.295410 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f1f2c5ba-d5db-4f94-91e2-89c5c1a373f5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:28.296797 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f1f2c5ba-d5db-4f94-91e2-89c5c1a373f5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:28.298037 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f1f2c5ba-d5db-4f94-91e2-89c5c1a373f5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:28.298791 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f1f2c5ba-d5db-4f94-91e2-89c5c1a373f5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:28.542227 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f1f2c5ba-d5db-4f94-91e2-89c5c1a373f5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:28.562426 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f1f2c5ba-d5db-4f94-91e2-89c5c1a373f5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:28.562426 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f1f2c5ba-d5db-4f94-91e2-89c5c1a373f5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:28.562426 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f1f2c5ba-d5db-4f94-91e2-89c5c1a373f5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1720 microversion: 2.20 time: 0.285123 Feb 19 02:32:28.563106 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 434/830] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:28 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1720 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:28.727835 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b77247e7-8b4c-4e3b-9770-4eb7175034c3 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Action: 'create', calling method: .version_select at 0x7f217d7150d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1114315365"}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:32:28.751245 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-b77247e7-8b4c-4e3b-9770-4eb7175034c3 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Getting quotas for project ed76decd92fc4f23bf841fd8f151e05c. Resources: {'key_pairs'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:32:28.755269 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-b77247e7-8b4c-4e3b-9770-4eb7175034c3 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Getting quotas for user 2bb2590036de478895f2fae1592cdd39 and project ed76decd92fc4f23bf841fd8f151e05c. Resources: {'key_pairs'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:32:28.824991 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-b77247e7-8b4c-4e3b-9770-4eb7175034c3 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Getting quotas for project ed76decd92fc4f23bf841fd8f151e05c. Resources: {'key_pairs'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:32:28.829164 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-b77247e7-8b4c-4e3b-9770-4eb7175034c3 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Getting quotas for user 2bb2590036de478895f2fae1592cdd39 and project ed76decd92fc4f23bf841fd8f151e05c. Resources: {'key_pairs'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:32:28.846966 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b77247e7-8b4c-4e3b-9770-4eb7175034c3 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.123731 Feb 19 02:32:28.847622 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 397/831] 10.222.0.44 () {60 vars in 1148 bytes} [Fri Feb 19 02:32:28 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:32:28.904542 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-916cadcc-805c-4998-8d34-e87e2bf91d50 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-137831643", "imageRef": "e31be683-7e34-4aef-8c9d-72934a97018c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1114315365", "networks": [{"uuid": "44a41470-32cc-4220-b6d8-4fa5cdef8de0"}]}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:32:28.971747 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-916cadcc-805c-4998-8d34-e87e2bf91d50 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] validate_networks() for [('44a41470-32cc-4220-b6d8-4fa5cdef8de0', None, None, None)] {{(pid=98193) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 02:32:29.581793 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5f352b5c-890a-4279-8d3f-e12ca187abbe tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:29.582591 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5f352b5c-890a-4279-8d3f-e12ca187abbe tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:29.590535 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5f352b5c-890a-4279-8d3f-e12ca187abbe tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:29.591049 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5f352b5c-890a-4279-8d3f-e12ca187abbe tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:29.591879 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5f352b5c-890a-4279-8d3f-e12ca187abbe tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:29.592364 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5f352b5c-890a-4279-8d3f-e12ca187abbe tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:29.798012 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-916cadcc-805c-4998-8d34-e87e2bf91d50 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Flavor limits 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 02:32:29.798539 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-916cadcc-805c-4998-8d34-e87e2bf91d50 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Image limits 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 02:32:29.799081 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-916cadcc-805c-4998-8d34-e87e2bf91d50 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Flavor pref 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 02:32:29.799581 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-916cadcc-805c-4998-8d34-e87e2bf91d50 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Image pref 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 02:32:29.800043 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-916cadcc-805c-4998-8d34-e87e2bf91d50 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 02:32:29.810636 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-916cadcc-805c-4998-8d34-e87e2bf91d50 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:29.811314 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-916cadcc-805c-4998-8d34-e87e2bf91d50 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:29.812194 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-916cadcc-805c-4998-8d34-e87e2bf91d50 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:29.812689 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-916cadcc-805c-4998-8d34-e87e2bf91d50 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:29.833023 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-916cadcc-805c-4998-8d34-e87e2bf91d50 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Getting quotas for project ed76decd92fc4f23bf841fd8f151e05c. Resources: {'ram', 'instances', 'cores'} {{(pid=98193) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:32:29.837617 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-916cadcc-805c-4998-8d34-e87e2bf91d50 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Getting quotas for user 2bb2590036de478895f2fae1592cdd39 and project ed76decd92fc4f23bf841fd8f151e05c. Resources: {'ram', 'instances', 'cores'} {{(pid=98193) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:32:29.849751 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-916cadcc-805c-4998-8d34-e87e2bf91d50 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Going to run 1 instances... {{(pid=98193) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 02:32:29.852535 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-916cadcc-805c-4998-8d34-e87e2bf91d50 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e31be683-7e34-4aef-8c9d-72934a97018c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=98193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 02:32:29.905897 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-916cadcc-805c-4998-8d34-e87e2bf91d50 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.005159 Feb 19 02:32:29.906744 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 435/832] 10.222.0.44 () {60 vars in 1137 bytes} [Fri Feb 19 02:32:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 1007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 02:32:29.918164 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-286fc659-c79a-4f10-92bb-6e52f570d8e1 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:29.918874 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-286fc659-c79a-4f10-92bb-6e52f570d8e1 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:30.013063 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-286fc659-c79a-4f10-92bb-6e52f570d8e1 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:30.023280 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-286fc659-c79a-4f10-92bb-6e52f570d8e1 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1258 microversion: 2.1 time: 0.109373 Feb 19 02:32:30.024275 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 436/833] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:32:29 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1258 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:32:30.075911 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5f352b5c-890a-4279-8d3f-e12ca187abbe tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:30.087003 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5f352b5c-890a-4279-8d3f-e12ca187abbe tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:30.088574 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5f352b5c-890a-4279-8d3f-e12ca187abbe tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:30.089790 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5f352b5c-890a-4279-8d3f-e12ca187abbe tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1720 microversion: 2.20 time: 0.512491 Feb 19 02:32:30.090405 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 398/834] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:29 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1720 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 02:32:31.041435 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c634e73d-325c-4d4d-a016-8cd134d6d7cf tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:31.042121 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c634e73d-325c-4d4d-a016-8cd134d6d7cf tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:31.050649 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c634e73d-325c-4d4d-a016-8cd134d6d7cf tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:31.051679 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c634e73d-325c-4d4d-a016-8cd134d6d7cf tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:31.052511 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c634e73d-325c-4d4d-a016-8cd134d6d7cf tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:31.052999 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c634e73d-325c-4d4d-a016-8cd134d6d7cf tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:31.109430 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-26b9ed70-3a08-4e45-bb60-3265fe5441b7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:31.110337 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-26b9ed70-3a08-4e45-bb60-3265fe5441b7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:31.123767 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-26b9ed70-3a08-4e45-bb60-3265fe5441b7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:31.124502 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-26b9ed70-3a08-4e45-bb60-3265fe5441b7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:31.125519 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-26b9ed70-3a08-4e45-bb60-3265fe5441b7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:31.126159 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-26b9ed70-3a08-4e45-bb60-3265fe5441b7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:31.186591 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c634e73d-325c-4d4d-a016-8cd134d6d7cf tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:31.196903 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c634e73d-325c-4d4d-a016-8cd134d6d7cf tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1318 microversion: 2.1 time: 0.159247 Feb 19 02:32:31.197738 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 437/835] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:32:31 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:32:31.521893 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-26b9ed70-3a08-4e45-bb60-3265fe5441b7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:31.531727 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-26b9ed70-3a08-4e45-bb60-3265fe5441b7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:31.533312 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-26b9ed70-3a08-4e45-bb60-3265fe5441b7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:31.534591 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-26b9ed70-3a08-4e45-bb60-3265fe5441b7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1663 microversion: 2.20 time: 0.429361 Feb 19 02:32:31.535934 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 399/836] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:31 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1663 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:31.555411 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-994c07af-d2ea-46a6-9af1-bc7a67060ae9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "870f71ae-e4be-4a83-9b16-43058362e499"}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:32:31.556691 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-994c07af-d2ea-46a6-9af1-bc7a67060ae9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:31.572035 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-994c07af-d2ea-46a6-9af1-bc7a67060ae9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:31.572660 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-994c07af-d2ea-46a6-9af1-bc7a67060ae9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:31.573415 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-994c07af-d2ea-46a6-9af1-bc7a67060ae9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:31.573911 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-994c07af-d2ea-46a6-9af1-bc7a67060ae9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:32.449194 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-6004d582-f660-4b6e-a485-11135d12eb74 req-03b8d5ab-6315-4ff0-82e0-db416394fa5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb5c58f3-abb6-4bda-8928-db72606dcefd", "name": "network-vif-unplugged", "status": "completed", "tag": "c6e75aba-17c0-47ae-b251-61c34117a52a"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:32:32.449194 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:32:32.449194 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:32:32.457325 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-6004d582-f660-4b6e-a485-11135d12eb74 req-03b8d5ab-6315-4ff0-82e0-db416394fa5e service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:32.458281 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-6004d582-f660-4b6e-a485-11135d12eb74 req-03b8d5ab-6315-4ff0-82e0-db416394fa5e service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:32.465579 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-994c07af-d2ea-46a6-9af1-bc7a67060ae9 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.914281 Feb 19 02:32:32.466273 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 438/837] 10.222.0.44 () {62 vars in 1354 bytes} [Fri Feb 19 02:32:31 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/os-volume_attachments => generated 188 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 19 02:32:32.474426 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-9eab18b1-c4d6-4d75-a3b7-eafac82993b2 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:32.475102 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-9eab18b1-c4d6-4d75-a3b7-eafac82993b2 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:32.497356 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.compute.server_external_events [req-6004d582-f660-4b6e-a485-11135d12eb74 req-03b8d5ab-6315-4ff0-82e0-db416394fa5e service nova] Unable to find a host for instance eb5c58f3-abb6-4bda-8928-db72606dcefd. Dropping event network-vif-unplugged {{(pid=98194) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Feb 19 02:32:32.498731 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-6004d582-f660-4b6e-a485-11135d12eb74 req-03b8d5ab-6315-4ff0-82e0-db416394fa5e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.297268 Feb 19 02:32:32.499621 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 400/838] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:32:32 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 299 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 19 02:32:32.521117 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9eab18b1-c4d6-4d75-a3b7-eafac82993b2 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:32.521690 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9eab18b1-c4d6-4d75-a3b7-eafac82993b2 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:32.523340 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9eab18b1-c4d6-4d75-a3b7-eafac82993b2 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:32.524280 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9eab18b1-c4d6-4d75-a3b7-eafac82993b2 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:32.599615 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-55f06aff-e362-47aa-8c55-9288b99e6019 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:32.600508 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-55f06aff-e362-47aa-8c55-9288b99e6019 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:32.615741 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-55f06aff-e362-47aa-8c55-9288b99e6019 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:32.616249 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-55f06aff-e362-47aa-8c55-9288b99e6019 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:32.617105 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-55f06aff-e362-47aa-8c55-9288b99e6019 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:32.617591 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-55f06aff-e362-47aa-8c55-9288b99e6019 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:32.904326 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9eab18b1-c4d6-4d75-a3b7-eafac82993b2 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:32.918650 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-9eab18b1-c4d6-4d75-a3b7-eafac82993b2 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1358 microversion: 2.1 time: 0.451155 Feb 19 02:32:32.926314 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 439/839] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:32:32 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1358 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:32:33.271041 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-55f06aff-e362-47aa-8c55-9288b99e6019 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "DELETE /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/os-volume_attachments/870f71ae-e4be-4a83-9b16-43058362e499" status: 202 len: 0 microversion: 2.20 time: 0.676365 Feb 19 02:32:33.272772 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 401/840] 10.222.0.44 () {60 vars in 1447 bytes} [Fri Feb 19 02:32:32 2021] DELETE /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/os-volume_attachments/870f71ae-e4be-4a83-9b16-43058362e499 => generated 0 bytes in 679 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 19 02:32:33.400663 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f3ebe0dc-dee3-46ca-9646-08f8176fe597 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:32:33.401283 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f3ebe0dc-dee3-46ca-9646-08f8176fe597 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:33.409648 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f3ebe0dc-dee3-46ca-9646-08f8176fe597 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:33.410184 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f3ebe0dc-dee3-46ca-9646-08f8176fe597 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:33.411101 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f3ebe0dc-dee3-46ca-9646-08f8176fe597 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:33.411592 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f3ebe0dc-dee3-46ca-9646-08f8176fe597 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:33.587229 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f3ebe0dc-dee3-46ca-9646-08f8176fe597 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action" status: 202 len: 0 microversion: 2.20 time: 0.190467 Feb 19 02:32:33.588044 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 440/841] 10.222.0.44 () {62 vars in 1309 bytes} [Fri Feb 19 02:32:33 2021] POST /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 19 02:32:33.596795 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-256d4a26-cce5-42d5-bee1-70fd72a87019 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:33.597473 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-256d4a26-cce5-42d5-bee1-70fd72a87019 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:33.605500 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-256d4a26-cce5-42d5-bee1-70fd72a87019 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:33.606012 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-256d4a26-cce5-42d5-bee1-70fd72a87019 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:33.606881 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-256d4a26-cce5-42d5-bee1-70fd72a87019 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:33.607382 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-256d4a26-cce5-42d5-bee1-70fd72a87019 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:33.828735 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-256d4a26-cce5-42d5-bee1-70fd72a87019 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:33.838124 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-256d4a26-cce5-42d5-bee1-70fd72a87019 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:33.839751 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-256d4a26-cce5-42d5-bee1-70fd72a87019 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:33.840977 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-256d4a26-cce5-42d5-bee1-70fd72a87019 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1671 microversion: 2.20 time: 0.248447 Feb 19 02:32:33.841773 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 402/842] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:33 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1671 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:33.944441 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a79246a7-7792-4fe7-a5fe-8a3456281951 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:33.945204 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a79246a7-7792-4fe7-a5fe-8a3456281951 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:33.969625 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a79246a7-7792-4fe7-a5fe-8a3456281951 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:33.970132 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a79246a7-7792-4fe7-a5fe-8a3456281951 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:33.971012 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a79246a7-7792-4fe7-a5fe-8a3456281951 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:33.971495 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a79246a7-7792-4fe7-a5fe-8a3456281951 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:34.340704 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a79246a7-7792-4fe7-a5fe-8a3456281951 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:34.350311 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a79246a7-7792-4fe7-a5fe-8a3456281951 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1358 microversion: 2.1 time: 0.410439 Feb 19 02:32:34.351002 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 441/843] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:32:33 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1358 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:32:34.868346 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-423944f8-087d-414b-9821-d80b1b5a61a3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:34.869502 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-423944f8-087d-414b-9821-d80b1b5a61a3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:34.883938 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-423944f8-087d-414b-9821-d80b1b5a61a3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:34.884501 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-423944f8-087d-414b-9821-d80b1b5a61a3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:34.885368 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-423944f8-087d-414b-9821-d80b1b5a61a3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:34.885862 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-423944f8-087d-414b-9821-d80b1b5a61a3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:35.138968 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-423944f8-087d-414b-9821-d80b1b5a61a3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:35.149715 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-423944f8-087d-414b-9821-d80b1b5a61a3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:35.151560 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-423944f8-087d-414b-9821-d80b1b5a61a3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:35.152845 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-423944f8-087d-414b-9821-d80b1b5a61a3 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1671 microversion: 2.20 time: 0.292000 Feb 19 02:32:35.153663 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 403/844] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:34 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1671 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:35.369280 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-6e2541cc-742e-4845-975a-545c966df5da tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:35.370283 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-6e2541cc-742e-4845-975a-545c966df5da tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:35.380098 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6e2541cc-742e-4845-975a-545c966df5da tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:35.380609 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6e2541cc-742e-4845-975a-545c966df5da tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:35.381461 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6e2541cc-742e-4845-975a-545c966df5da tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:35.381960 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6e2541cc-742e-4845-975a-545c966df5da tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:35.611293 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-6e2541cc-742e-4845-975a-545c966df5da tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:35.620736 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-6e2541cc-742e-4845-975a-545c966df5da tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1358 microversion: 2.1 time: 0.255607 Feb 19 02:32:35.621440 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 442/845] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:32:35 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1358 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:32:36.173077 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f890b3f5-8604-4211-9a3d-cb1408cf1d65 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:36.173743 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f890b3f5-8604-4211-9a3d-cb1408cf1d65 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:36.182614 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f890b3f5-8604-4211-9a3d-cb1408cf1d65 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:36.183068 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f890b3f5-8604-4211-9a3d-cb1408cf1d65 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:36.183927 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f890b3f5-8604-4211-9a3d-cb1408cf1d65 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:36.184423 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f890b3f5-8604-4211-9a3d-cb1408cf1d65 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:36.396569 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f890b3f5-8604-4211-9a3d-cb1408cf1d65 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:36.405883 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f890b3f5-8604-4211-9a3d-cb1408cf1d65 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:36.407494 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f890b3f5-8604-4211-9a3d-cb1408cf1d65 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:36.408707 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f890b3f5-8604-4211-9a3d-cb1408cf1d65 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1671 microversion: 2.20 time: 0.239749 Feb 19 02:32:36.409320 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 404/846] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:36 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1671 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:36.641474 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-11155807-11d4-4870-b303-a3e7626efc31 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:36.642088 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-11155807-11d4-4870-b303-a3e7626efc31 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:36.650202 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-11155807-11d4-4870-b303-a3e7626efc31 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:36.650784 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-11155807-11d4-4870-b303-a3e7626efc31 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:36.651620 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-11155807-11d4-4870-b303-a3e7626efc31 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:36.652107 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-11155807-11d4-4870-b303-a3e7626efc31 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:36.885375 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-11155807-11d4-4870-b303-a3e7626efc31 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:36.896822 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-11155807-11d4-4870-b303-a3e7626efc31 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1358 microversion: 2.1 time: 0.259409 Feb 19 02:32:36.898337 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 443/847] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:32:36 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1358 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:32:37.429155 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-98638470-a199-4603-872f-38bb90797313 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:37.429790 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-98638470-a199-4603-872f-38bb90797313 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:37.437692 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-98638470-a199-4603-872f-38bb90797313 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:37.438205 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-98638470-a199-4603-872f-38bb90797313 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:37.439143 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-98638470-a199-4603-872f-38bb90797313 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:37.439636 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-98638470-a199-4603-872f-38bb90797313 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:37.677997 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-98638470-a199-4603-872f-38bb90797313 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:37.687508 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-98638470-a199-4603-872f-38bb90797313 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:37.689029 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-98638470-a199-4603-872f-38bb90797313 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:37.690267 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-98638470-a199-4603-872f-38bb90797313 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1671 microversion: 2.20 time: 0.265262 Feb 19 02:32:37.690939 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 405/848] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:37 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1671 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:37.926478 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e332fb3a-8d98-449b-92ae-e11843d38cf0 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:37.927248 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e332fb3a-8d98-449b-92ae-e11843d38cf0 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:37.943115 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e332fb3a-8d98-449b-92ae-e11843d38cf0 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:37.943554 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e332fb3a-8d98-449b-92ae-e11843d38cf0 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:37.944420 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e332fb3a-8d98-449b-92ae-e11843d38cf0 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:37.944973 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e332fb3a-8d98-449b-92ae-e11843d38cf0 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:38.177676 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e332fb3a-8d98-449b-92ae-e11843d38cf0 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:38.187084 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e332fb3a-8d98-449b-92ae-e11843d38cf0 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1358 microversion: 2.1 time: 0.275066 Feb 19 02:32:38.187794 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 444/849] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:32:37 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1358 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:32:38.711050 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d1d4e383-293f-4ca6-8e33-8273c9e51dcc tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:38.711715 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d1d4e383-293f-4ca6-8e33-8273c9e51dcc tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:38.719574 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d1d4e383-293f-4ca6-8e33-8273c9e51dcc tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:38.720076 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d1d4e383-293f-4ca6-8e33-8273c9e51dcc tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:38.720900 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d1d4e383-293f-4ca6-8e33-8273c9e51dcc tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:38.721382 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d1d4e383-293f-4ca6-8e33-8273c9e51dcc tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:38.945040 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-d1d4e383-293f-4ca6-8e33-8273c9e51dcc tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:38.955449 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-d1d4e383-293f-4ca6-8e33-8273c9e51dcc tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:38.957074 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-d1d4e383-293f-4ca6-8e33-8273c9e51dcc tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:38.958750 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d1d4e383-293f-4ca6-8e33-8273c9e51dcc tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1671 microversion: 2.20 time: 0.251630 Feb 19 02:32:38.959579 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 406/850] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:38 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1671 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:39.205474 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f3ddf79c-c629-44d0-abd8-8a2f79153423 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:39.206138 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f3ddf79c-c629-44d0-abd8-8a2f79153423 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:39.214914 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f3ddf79c-c629-44d0-abd8-8a2f79153423 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:39.215423 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f3ddf79c-c629-44d0-abd8-8a2f79153423 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:39.216303 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f3ddf79c-c629-44d0-abd8-8a2f79153423 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:39.216744 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f3ddf79c-c629-44d0-abd8-8a2f79153423 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:39.433484 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f3ddf79c-c629-44d0-abd8-8a2f79153423 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:39.443003 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f3ddf79c-c629-44d0-abd8-8a2f79153423 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1358 microversion: 2.1 time: 0.241720 Feb 19 02:32:39.454860 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 445/851] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:32:39 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:32:39.979439 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-022ddb20-1e94-4b6b-b472-796e70360760 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:39.980099 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-022ddb20-1e94-4b6b-b472-796e70360760 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:39.988116 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-022ddb20-1e94-4b6b-b472-796e70360760 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:39.988618 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-022ddb20-1e94-4b6b-b472-796e70360760 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:39.989483 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-022ddb20-1e94-4b6b-b472-796e70360760 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:39.989970 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-022ddb20-1e94-4b6b-b472-796e70360760 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:40.220249 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-022ddb20-1e94-4b6b-b472-796e70360760 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:40.233143 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-022ddb20-1e94-4b6b-b472-796e70360760 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:40.234739 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-022ddb20-1e94-4b6b-b472-796e70360760 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:40.241654 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-022ddb20-1e94-4b6b-b472-796e70360760 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1671 microversion: 2.20 time: 0.266268 Feb 19 02:32:40.242415 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 407/852] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:39 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1671 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:40.464558 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-3ac077cf-0590-448a-9c99-dca81e524ff7 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:40.465161 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-3ac077cf-0590-448a-9c99-dca81e524ff7 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:40.473075 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3ac077cf-0590-448a-9c99-dca81e524ff7 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:40.473584 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3ac077cf-0590-448a-9c99-dca81e524ff7 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:40.474447 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3ac077cf-0590-448a-9c99-dca81e524ff7 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:40.474946 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3ac077cf-0590-448a-9c99-dca81e524ff7 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:40.705751 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-3ac077cf-0590-448a-9c99-dca81e524ff7 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:40.714783 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-3ac077cf-0590-448a-9c99-dca81e524ff7 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1358 microversion: 2.1 time: 0.254194 Feb 19 02:32:40.715360 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 446/853] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:32:40 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:32:41.263626 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-150d6fc7-780a-47d8-8843-7c75b160d438 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:41.264298 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-150d6fc7-780a-47d8-8843-7c75b160d438 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:41.272305 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-150d6fc7-780a-47d8-8843-7c75b160d438 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:41.272821 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-150d6fc7-780a-47d8-8843-7c75b160d438 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:41.273672 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-150d6fc7-780a-47d8-8843-7c75b160d438 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:41.274161 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-150d6fc7-780a-47d8-8843-7c75b160d438 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:41.492379 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-150d6fc7-780a-47d8-8843-7c75b160d438 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:41.501688 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-150d6fc7-780a-47d8-8843-7c75b160d438 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:41.503292 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-150d6fc7-780a-47d8-8843-7c75b160d438 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:41.505094 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-150d6fc7-780a-47d8-8843-7c75b160d438 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1671 microversion: 2.20 time: 0.245692 Feb 19 02:32:41.505713 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 408/854] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:41 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1671 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:41.733106 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1ae38691-5f51-485c-b29d-5ac77d913a19 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:41.733769 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1ae38691-5f51-485c-b29d-5ac77d913a19 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:41.742597 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1ae38691-5f51-485c-b29d-5ac77d913a19 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:41.743108 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1ae38691-5f51-485c-b29d-5ac77d913a19 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:41.743961 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1ae38691-5f51-485c-b29d-5ac77d913a19 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:41.744457 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1ae38691-5f51-485c-b29d-5ac77d913a19 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:41.960385 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-1ae38691-5f51-485c-b29d-5ac77d913a19 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:41.969366 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1ae38691-5f51-485c-b29d-5ac77d913a19 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1358 microversion: 2.1 time: 0.240294 Feb 19 02:32:41.969981 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 447/855] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:32:41 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:32:42.524967 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-bbc7573e-64c9-42ef-8715-94be916ffe41 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:42.525632 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-bbc7573e-64c9-42ef-8715-94be916ffe41 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:42.533392 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bbc7573e-64c9-42ef-8715-94be916ffe41 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:42.533893 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bbc7573e-64c9-42ef-8715-94be916ffe41 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:42.534813 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bbc7573e-64c9-42ef-8715-94be916ffe41 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:42.535821 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bbc7573e-64c9-42ef-8715-94be916ffe41 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:42.775929 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-bbc7573e-64c9-42ef-8715-94be916ffe41 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:42.786104 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-bbc7573e-64c9-42ef-8715-94be916ffe41 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:42.787726 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-bbc7573e-64c9-42ef-8715-94be916ffe41 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:42.788972 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-bbc7573e-64c9-42ef-8715-94be916ffe41 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1671 microversion: 2.20 time: 0.268117 Feb 19 02:32:42.790021 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 409/856] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:42 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1671 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:42.988235 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ec69c653-f092-48d5-8e13-a6fb0c7e245b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:42.988840 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ec69c653-f092-48d5-8e13-a6fb0c7e245b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:42.996693 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ec69c653-f092-48d5-8e13-a6fb0c7e245b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:42.997201 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ec69c653-f092-48d5-8e13-a6fb0c7e245b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:42.998030 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ec69c653-f092-48d5-8e13-a6fb0c7e245b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:42.998668 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ec69c653-f092-48d5-8e13-a6fb0c7e245b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:43.208905 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ec69c653-f092-48d5-8e13-a6fb0c7e245b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:43.217941 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ec69c653-f092-48d5-8e13-a6fb0c7e245b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1358 microversion: 2.1 time: 0.233800 Feb 19 02:32:43.218592 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 448/857] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:32:42 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:32:43.809017 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-69878902-dbb4-440c-b4c9-04a12429f8ae tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:43.809625 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-69878902-dbb4-440c-b4c9-04a12429f8ae tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:43.818119 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-69878902-dbb4-440c-b4c9-04a12429f8ae tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:43.818621 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-69878902-dbb4-440c-b4c9-04a12429f8ae tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:43.819437 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-69878902-dbb4-440c-b4c9-04a12429f8ae tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:43.819926 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-69878902-dbb4-440c-b4c9-04a12429f8ae tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:44.216908 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-69878902-dbb4-440c-b4c9-04a12429f8ae tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:44.227331 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-69878902-dbb4-440c-b4c9-04a12429f8ae tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:44.229734 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-69878902-dbb4-440c-b4c9-04a12429f8ae tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:44.230762 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-69878902-dbb4-440c-b4c9-04a12429f8ae tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1671 microversion: 2.20 time: 0.425801 Feb 19 02:32:44.231481 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 410/858] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:43 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1671 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:44.235110 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7917b32c-9c04-4ac9-8ad6-a5c7351c10eb tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:44.235923 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7917b32c-9c04-4ac9-8ad6-a5c7351c10eb tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:44.245068 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7917b32c-9c04-4ac9-8ad6-a5c7351c10eb tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:44.245584 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7917b32c-9c04-4ac9-8ad6-a5c7351c10eb tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:44.246472 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7917b32c-9c04-4ac9-8ad6-a5c7351c10eb tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:44.247156 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7917b32c-9c04-4ac9-8ad6-a5c7351c10eb tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:44.716912 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7917b32c-9c04-4ac9-8ad6-a5c7351c10eb tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:44.729416 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7917b32c-9c04-4ac9-8ad6-a5c7351c10eb tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1358 microversion: 2.1 time: 0.498196 Feb 19 02:32:44.732150 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 449/859] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:32:44 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1358 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:32:45.251538 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-93be2abc-cf9a-4c83-9bf2-76cd99223a9b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:45.252119 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-93be2abc-cf9a-4c83-9bf2-76cd99223a9b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:45.260603 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-93be2abc-cf9a-4c83-9bf2-76cd99223a9b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:45.261157 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-93be2abc-cf9a-4c83-9bf2-76cd99223a9b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:45.262001 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-93be2abc-cf9a-4c83-9bf2-76cd99223a9b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:45.262554 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-93be2abc-cf9a-4c83-9bf2-76cd99223a9b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:45.316779 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-e84003ba-3287-4d67-8395-f6dfdd8e95f3 req-fb5209c5-4984-492b-b688-0b37b1c1b14e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec6a4f24-919b-4160-9c5f-07d6513e1e08", "tag": "2d39a22b-39a7-4bd0-b9ae-911a223833df"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:32:45.318564 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:32:45.318564 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:32:45.344112 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-e84003ba-3287-4d67-8395-f6dfdd8e95f3 req-fb5209c5-4984-492b-b688-0b37b1c1b14e service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:45.344620 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-e84003ba-3287-4d67-8395-f6dfdd8e95f3 req-fb5209c5-4984-492b-b688-0b37b1c1b14e service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:45.367351 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-e84003ba-3287-4d67-8395-f6dfdd8e95f3 req-fb5209c5-4984-492b-b688-0b37b1c1b14e service nova] Creating event network-changed:2d39a22b-39a7-4bd0-b9ae-911a223833df for instance ec6a4f24-919b-4160-9c5f-07d6513e1e08 on hv-cinder-77642 Feb 19 02:32:45.372825 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-e84003ba-3287-4d67-8395-f6dfdd8e95f3 req-fb5209c5-4984-492b-b688-0b37b1c1b14e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060236 Feb 19 02:32:45.373825 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 450/860] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:32:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:32:45.768356 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f1cbc9fe-af71-498c-8ea8-54d0a020052e tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:45.772407 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f1cbc9fe-af71-498c-8ea8-54d0a020052e tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:45.787278 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f1cbc9fe-af71-498c-8ea8-54d0a020052e tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:45.788088 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f1cbc9fe-af71-498c-8ea8-54d0a020052e tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:45.789067 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f1cbc9fe-af71-498c-8ea8-54d0a020052e tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:45.789680 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f1cbc9fe-af71-498c-8ea8-54d0a020052e tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:45.908021 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-93be2abc-cf9a-4c83-9bf2-76cd99223a9b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:45.917755 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-93be2abc-cf9a-4c83-9bf2-76cd99223a9b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:45.919570 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-93be2abc-cf9a-4c83-9bf2-76cd99223a9b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:45.921180 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-93be2abc-cf9a-4c83-9bf2-76cd99223a9b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1729 microversion: 2.20 time: 0.674013 Feb 19 02:32:45.922075 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 411/861] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:45 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1729 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:45.941947 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7a052e89-e531-4149-85f1-b4fe9cf67acd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:45.943370 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7a052e89-e531-4149-85f1-b4fe9cf67acd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:45.953413 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7a052e89-e531-4149-85f1-b4fe9cf67acd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:45.954123 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7a052e89-e531-4149-85f1-b4fe9cf67acd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:45.955295 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7a052e89-e531-4149-85f1-b4fe9cf67acd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:45.955994 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7a052e89-e531-4149-85f1-b4fe9cf67acd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:46.039874 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7a052e89-e531-4149-85f1-b4fe9cf67acd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116378 Feb 19 02:32:46.040899 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 412/862] 10.222.0.44 () {58 vars in 1292 bytes} [Fri Feb 19 02:32:45 2021] GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:32:46.053492 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-12cdc5b9-a2e0-4ab2-b5c1-fa57b63e20f4 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:46.054471 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-12cdc5b9-a2e0-4ab2-b5c1-fa57b63e20f4 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:46.063729 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-12cdc5b9-a2e0-4ab2-b5c1-fa57b63e20f4 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:46.064598 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-12cdc5b9-a2e0-4ab2-b5c1-fa57b63e20f4 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:46.065802 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-12cdc5b9-a2e0-4ab2-b5c1-fa57b63e20f4 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:46.066722 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-12cdc5b9-a2e0-4ab2-b5c1-fa57b63e20f4 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:46.115538 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f1cbc9fe-af71-498c-8ea8-54d0a020052e tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:46.131116 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f1cbc9fe-af71-498c-8ea8-54d0a020052e tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1358 microversion: 2.1 time: 0.386530 Feb 19 02:32:46.132025 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 451/863] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:32:45 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1358 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:32:46.178575 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-12cdc5b9-a2e0-4ab2-b5c1-fa57b63e20f4 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/os-volume_attachments/13cfcc28-aeb8-4a69-9cec-6043c900a4f0" status: 200 len: 194 microversion: 2.1 time: 0.130501 Feb 19 02:32:46.179219 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 413/864] 10.222.0.44 () {58 vars in 1403 bytes} [Fri Feb 19 02:32:46 2021] GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/os-volume_attachments/13cfcc28-aeb8-4a69-9cec-6043c900a4f0 => generated 194 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:32:46.942159 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-407617b1-eb71-4c11-acc0-719ba8ae4e10 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:46.942787 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-407617b1-eb71-4c11-acc0-719ba8ae4e10 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:46.951163 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-407617b1-eb71-4c11-acc0-719ba8ae4e10 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:46.951463 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-407617b1-eb71-4c11-acc0-719ba8ae4e10 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:46.952794 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-407617b1-eb71-4c11-acc0-719ba8ae4e10 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:46.953293 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-407617b1-eb71-4c11-acc0-719ba8ae4e10 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:47.150288 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-20299947-8bb3-4ab5-b9e2-a62e999e97d5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:47.151016 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-20299947-8bb3-4ab5-b9e2-a62e999e97d5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:47.159041 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-20299947-8bb3-4ab5-b9e2-a62e999e97d5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:47.160339 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-20299947-8bb3-4ab5-b9e2-a62e999e97d5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:47.171995 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-20299947-8bb3-4ab5-b9e2-a62e999e97d5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:47.171995 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-20299947-8bb3-4ab5-b9e2-a62e999e97d5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:47.172207 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-407617b1-eb71-4c11-acc0-719ba8ae4e10 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:47.183313 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-407617b1-eb71-4c11-acc0-719ba8ae4e10 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:47.184827 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-407617b1-eb71-4c11-acc0-719ba8ae4e10 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:47.186068 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-407617b1-eb71-4c11-acc0-719ba8ae4e10 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1729 microversion: 2.20 time: 0.248673 Feb 19 02:32:47.186705 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 452/865] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:46 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1729 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:47.408112 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-20299947-8bb3-4ab5-b9e2-a62e999e97d5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:47.418009 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-20299947-8bb3-4ab5-b9e2-a62e999e97d5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1358 microversion: 2.1 time: 0.271961 Feb 19 02:32:47.418674 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 414/866] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:32:47 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1358 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:32:47.862749 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-01a39dd5-06dd-42b1-b840-ea961fdacabd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "22f8b4e1-f206-43fc-a6ed-9df4d8ac91c8"}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:32:47.864551 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-01a39dd5-06dd-42b1-b840-ea961fdacabd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:47.872499 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-01a39dd5-06dd-42b1-b840-ea961fdacabd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:47.873002 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-01a39dd5-06dd-42b1-b840-ea961fdacabd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:47.873843 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-01a39dd5-06dd-42b1-b840-ea961fdacabd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:47.874331 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-01a39dd5-06dd-42b1-b840-ea961fdacabd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:48.205954 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-9669de41-6805-45b0-8ef4-0591f540e00f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:48.206818 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-9669de41-6805-45b0-8ef4-0591f540e00f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:48.215611 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9669de41-6805-45b0-8ef4-0591f540e00f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:48.216228 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9669de41-6805-45b0-8ef4-0591f540e00f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:48.217073 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9669de41-6805-45b0-8ef4-0591f540e00f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:48.217566 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9669de41-6805-45b0-8ef4-0591f540e00f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:48.439584 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9669de41-6805-45b0-8ef4-0591f540e00f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:48.449415 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9669de41-6805-45b0-8ef4-0591f540e00f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:48.451063 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9669de41-6805-45b0-8ef4-0591f540e00f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:48.452545 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-9669de41-6805-45b0-8ef4-0591f540e00f tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1729 microversion: 2.20 time: 0.250806 Feb 19 02:32:48.453154 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 415/867] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:48 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1729 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 02:32:48.457866 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-054e4c54-de5e-444c-898f-1f6d1fb11f26 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:48.458598 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-054e4c54-de5e-444c-898f-1f6d1fb11f26 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:48.466453 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-054e4c54-de5e-444c-898f-1f6d1fb11f26 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:48.466971 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-054e4c54-de5e-444c-898f-1f6d1fb11f26 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:48.467821 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-054e4c54-de5e-444c-898f-1f6d1fb11f26 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:48.468316 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-054e4c54-de5e-444c-898f-1f6d1fb11f26 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:48.688690 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-054e4c54-de5e-444c-898f-1f6d1fb11f26 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:48.699458 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-054e4c54-de5e-444c-898f-1f6d1fb11f26 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1358 microversion: 2.1 time: 0.245234 Feb 19 02:32:48.700069 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 416/868] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:32:48 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:32:49.473286 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-aa9112b4-c42b-4948-a14f-83d41d40689b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:49.474043 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-aa9112b4-c42b-4948-a14f-83d41d40689b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:49.481992 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-aa9112b4-c42b-4948-a14f-83d41d40689b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:49.482559 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-aa9112b4-c42b-4948-a14f-83d41d40689b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:49.483405 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-aa9112b4-c42b-4948-a14f-83d41d40689b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:49.483903 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-aa9112b4-c42b-4948-a14f-83d41d40689b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:49.707450 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-aa9112b4-c42b-4948-a14f-83d41d40689b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:49.717566 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-aa9112b4-c42b-4948-a14f-83d41d40689b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:49.719344 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-aa9112b4-c42b-4948-a14f-83d41d40689b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:49.720570 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-aa9112b4-c42b-4948-a14f-83d41d40689b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1729 microversion: 2.20 time: 0.252088 Feb 19 02:32:49.721175 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 417/869] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:49 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1729 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 02:32:49.726245 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8badf8ee-9461-4b2f-bb39-fec1d143ee9c tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:49.726896 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8badf8ee-9461-4b2f-bb39-fec1d143ee9c tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:49.735401 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8badf8ee-9461-4b2f-bb39-fec1d143ee9c tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:49.735908 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8badf8ee-9461-4b2f-bb39-fec1d143ee9c tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:49.736762 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8badf8ee-9461-4b2f-bb39-fec1d143ee9c tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:49.737311 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8badf8ee-9461-4b2f-bb39-fec1d143ee9c tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:49.964435 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8badf8ee-9461-4b2f-bb39-fec1d143ee9c tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:49.983384 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8badf8ee-9461-4b2f-bb39-fec1d143ee9c tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1358 microversion: 2.1 time: 0.260971 Feb 19 02:32:49.983947 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 418/870] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:32:49 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1358 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:32:50.739597 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-32774dbd-5819-443e-88a1-67fc82c71b29 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:50.740774 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-32774dbd-5819-443e-88a1-67fc82c71b29 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:50.748380 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-32774dbd-5819-443e-88a1-67fc82c71b29 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:50.748894 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-32774dbd-5819-443e-88a1-67fc82c71b29 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:50.749743 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-32774dbd-5819-443e-88a1-67fc82c71b29 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:50.750236 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-32774dbd-5819-443e-88a1-67fc82c71b29 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:51.001695 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-32774dbd-5819-443e-88a1-67fc82c71b29 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:51.012412 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-32774dbd-5819-443e-88a1-67fc82c71b29 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:51.014128 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-32774dbd-5819-443e-88a1-67fc82c71b29 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:51.015425 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-32774dbd-5819-443e-88a1-67fc82c71b29 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1729 microversion: 2.20 time: 0.279979 Feb 19 02:32:51.016060 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 419/871] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:50 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1729 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 02:32:51.021229 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-56733b1f-be6b-4325-84a2-3dd040a6f46f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:51.021903 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-56733b1f-be6b-4325-84a2-3dd040a6f46f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:51.030755 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-56733b1f-be6b-4325-84a2-3dd040a6f46f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:51.031599 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-56733b1f-be6b-4325-84a2-3dd040a6f46f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:51.032461 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-56733b1f-be6b-4325-84a2-3dd040a6f46f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:51.032957 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-56733b1f-be6b-4325-84a2-3dd040a6f46f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:51.260372 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-56733b1f-be6b-4325-84a2-3dd040a6f46f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:51.269632 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-56733b1f-be6b-4325-84a2-3dd040a6f46f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1358 microversion: 2.1 time: 0.252462 Feb 19 02:32:51.270263 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 420/872] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:32:51 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:32:52.037617 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8454c78a-7beb-4faa-95a4-4163328d023b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:52.038222 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8454c78a-7beb-4faa-95a4-4163328d023b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:52.046459 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8454c78a-7beb-4faa-95a4-4163328d023b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:52.046972 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8454c78a-7beb-4faa-95a4-4163328d023b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:52.052467 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8454c78a-7beb-4faa-95a4-4163328d023b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:52.052988 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8454c78a-7beb-4faa-95a4-4163328d023b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:52.280461 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8454c78a-7beb-4faa-95a4-4163328d023b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:52.291068 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8454c78a-7beb-4faa-95a4-4163328d023b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:52.292694 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8454c78a-7beb-4faa-95a4-4163328d023b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:52.294388 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8454c78a-7beb-4faa-95a4-4163328d023b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1729 microversion: 2.20 time: 0.261369 Feb 19 02:32:52.295259 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 421/873] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:52 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1729 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 02:32:52.304061 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5e908085-ceef-4e6c-ae82-696a00af4ae1 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:52.305004 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5e908085-ceef-4e6c-ae82-696a00af4ae1 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:52.313196 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5e908085-ceef-4e6c-ae82-696a00af4ae1 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:52.313707 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5e908085-ceef-4e6c-ae82-696a00af4ae1 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:52.314627 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5e908085-ceef-4e6c-ae82-696a00af4ae1 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:52.315125 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5e908085-ceef-4e6c-ae82-696a00af4ae1 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:52.533971 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5e908085-ceef-4e6c-ae82-696a00af4ae1 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:52.543732 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5e908085-ceef-4e6c-ae82-696a00af4ae1 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1358 microversion: 2.1 time: 0.243666 Feb 19 02:32:52.544411 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 422/874] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:32:52 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:32:53.315501 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-56967111-ce82-41c5-b8a0-6463c8f04dc1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:53.316213 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-56967111-ce82-41c5-b8a0-6463c8f04dc1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:53.324607 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-56967111-ce82-41c5-b8a0-6463c8f04dc1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:53.325209 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-56967111-ce82-41c5-b8a0-6463c8f04dc1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:53.326135 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-56967111-ce82-41c5-b8a0-6463c8f04dc1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:53.326729 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-56967111-ce82-41c5-b8a0-6463c8f04dc1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:53.547916 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-56967111-ce82-41c5-b8a0-6463c8f04dc1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:53.558783 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-56967111-ce82-41c5-b8a0-6463c8f04dc1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:53.560543 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-56967111-ce82-41c5-b8a0-6463c8f04dc1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:53.561783 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-56967111-ce82-41c5-b8a0-6463c8f04dc1 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1729 microversion: 2.20 time: 0.250599 Feb 19 02:32:53.562411 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 423/875] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:53 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1729 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 02:32:53.567321 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-3b47d206-7f7d-4f7f-a357-30bb66b2027f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:53.568083 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-3b47d206-7f7d-4f7f-a357-30bb66b2027f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:53.577491 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3b47d206-7f7d-4f7f-a357-30bb66b2027f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:53.577981 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3b47d206-7f7d-4f7f-a357-30bb66b2027f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:53.578921 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3b47d206-7f7d-4f7f-a357-30bb66b2027f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:53.579410 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3b47d206-7f7d-4f7f-a357-30bb66b2027f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:53.801962 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-3b47d206-7f7d-4f7f-a357-30bb66b2027f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:53.811486 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-3b47d206-7f7d-4f7f-a357-30bb66b2027f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1358 microversion: 2.1 time: 0.247974 Feb 19 02:32:53.812120 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 424/876] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:32:53 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:32:54.582627 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-45a7a2a4-2256-4fe6-a351-94ec85365bb7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:54.583477 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-45a7a2a4-2256-4fe6-a351-94ec85365bb7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:54.591596 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-45a7a2a4-2256-4fe6-a351-94ec85365bb7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:54.592098 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-45a7a2a4-2256-4fe6-a351-94ec85365bb7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:54.592942 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-45a7a2a4-2256-4fe6-a351-94ec85365bb7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:54.593453 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-45a7a2a4-2256-4fe6-a351-94ec85365bb7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:54.812145 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-45a7a2a4-2256-4fe6-a351-94ec85365bb7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:54.822301 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-45a7a2a4-2256-4fe6-a351-94ec85365bb7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:54.823899 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-45a7a2a4-2256-4fe6-a351-94ec85365bb7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:54.825370 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-45a7a2a4-2256-4fe6-a351-94ec85365bb7 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1729 microversion: 2.20 time: 0.247158 Feb 19 02:32:54.826000 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 425/877] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:54 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1729 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 02:32:54.830845 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-bf5890f6-0ae7-464a-80d2-3aed42dde8b6 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:54.832309 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-bf5890f6-0ae7-464a-80d2-3aed42dde8b6 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:54.840631 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bf5890f6-0ae7-464a-80d2-3aed42dde8b6 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:54.841237 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bf5890f6-0ae7-464a-80d2-3aed42dde8b6 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:54.842272 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bf5890f6-0ae7-464a-80d2-3aed42dde8b6 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:54.842821 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bf5890f6-0ae7-464a-80d2-3aed42dde8b6 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:55.094877 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-bf5890f6-0ae7-464a-80d2-3aed42dde8b6 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:55.104249 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-bf5890f6-0ae7-464a-80d2-3aed42dde8b6 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1358 microversion: 2.1 time: 0.277146 Feb 19 02:32:55.104878 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 426/878] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:32:54 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1358 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:32:55.847008 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-3546dbbe-21ae-49aa-b48b-4a71480d5390 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:55.847673 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-3546dbbe-21ae-49aa-b48b-4a71480d5390 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:55.855657 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3546dbbe-21ae-49aa-b48b-4a71480d5390 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:55.856185 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3546dbbe-21ae-49aa-b48b-4a71480d5390 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:55.857068 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3546dbbe-21ae-49aa-b48b-4a71480d5390 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:55.857564 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3546dbbe-21ae-49aa-b48b-4a71480d5390 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:56.070845 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-3546dbbe-21ae-49aa-b48b-4a71480d5390 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:56.080433 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-3546dbbe-21ae-49aa-b48b-4a71480d5390 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:56.082025 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-3546dbbe-21ae-49aa-b48b-4a71480d5390 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:56.083250 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-3546dbbe-21ae-49aa-b48b-4a71480d5390 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1729 microversion: 2.20 time: 0.240284 Feb 19 02:32:56.083858 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 427/879] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:55 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1729 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 19 02:32:56.122631 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-180705d7-a88f-4e53-8da1-650e37f5a2f5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:56.123221 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-180705d7-a88f-4e53-8da1-650e37f5a2f5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:56.131405 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-180705d7-a88f-4e53-8da1-650e37f5a2f5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:56.132045 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-180705d7-a88f-4e53-8da1-650e37f5a2f5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:56.132865 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-180705d7-a88f-4e53-8da1-650e37f5a2f5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:56.133349 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-180705d7-a88f-4e53-8da1-650e37f5a2f5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:56.363290 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-01a39dd5-06dd-42b1-b840-ea961fdacabd tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.504975 Feb 19 02:32:56.364166 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 453/880] 10.222.0.44 () {60 vars in 1313 bytes} [Fri Feb 19 02:32:47 2021] POST /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/os-volume_attachments => generated 194 bytes in 8507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:32:56.542226 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-180705d7-a88f-4e53-8da1-650e37f5a2f5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:56.551766 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-180705d7-a88f-4e53-8da1-650e37f5a2f5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1358 microversion: 2.1 time: 0.432800 Feb 19 02:32:56.552573 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 428/881] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:32:56 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1358 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:32:57.104016 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d10b698a-d0d3-4f7e-addc-7f577992563e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:57.104770 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d10b698a-d0d3-4f7e-addc-7f577992563e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:57.114288 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d10b698a-d0d3-4f7e-addc-7f577992563e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:57.114814 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d10b698a-d0d3-4f7e-addc-7f577992563e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:57.115649 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d10b698a-d0d3-4f7e-addc-7f577992563e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:57.116294 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d10b698a-d0d3-4f7e-addc-7f577992563e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:57.329054 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-d10b698a-d0d3-4f7e-addc-7f577992563e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:57.338281 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-d10b698a-d0d3-4f7e-addc-7f577992563e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:57.339878 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-d10b698a-d0d3-4f7e-addc-7f577992563e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:57.341090 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d10b698a-d0d3-4f7e-addc-7f577992563e tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1729 microversion: 2.20 time: 0.241635 Feb 19 02:32:57.341703 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 454/882] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:57 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1729 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:57.569984 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-9904193b-7c87-4b03-9238-d102f793c62b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:57.570714 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-9904193b-7c87-4b03-9238-d102f793c62b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:57.579014 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9904193b-7c87-4b03-9238-d102f793c62b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:57.579525 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9904193b-7c87-4b03-9238-d102f793c62b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:57.580380 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9904193b-7c87-4b03-9238-d102f793c62b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:57.580848 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9904193b-7c87-4b03-9238-d102f793c62b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:57.789826 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9904193b-7c87-4b03-9238-d102f793c62b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:57.798962 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-9904193b-7c87-4b03-9238-d102f793c62b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1358 microversion: 2.1 time: 0.233625 Feb 19 02:32:57.799595 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 429/883] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:32:57 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:32:58.361709 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a0bb1300-cf3e-4544-9f97-3361417095c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:58.362395 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a0bb1300-cf3e-4544-9f97-3361417095c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:58.370705 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a0bb1300-cf3e-4544-9f97-3361417095c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:58.371208 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a0bb1300-cf3e-4544-9f97-3361417095c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:58.372037 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a0bb1300-cf3e-4544-9f97-3361417095c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:58.372521 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a0bb1300-cf3e-4544-9f97-3361417095c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:58.583678 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a0bb1300-cf3e-4544-9f97-3361417095c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:58.593040 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a0bb1300-cf3e-4544-9f97-3361417095c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:58.594673 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a0bb1300-cf3e-4544-9f97-3361417095c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:58.595910 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a0bb1300-cf3e-4544-9f97-3361417095c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1729 microversion: 2.20 time: 0.238591 Feb 19 02:32:58.596522 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 455/884] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:58 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1729 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:32:58.818203 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-033c9678-1254-4c80-9158-02d8d31e0630 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:58.818897 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-033c9678-1254-4c80-9158-02d8d31e0630 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:58.827046 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-033c9678-1254-4c80-9158-02d8d31e0630 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:58.827816 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-033c9678-1254-4c80-9158-02d8d31e0630 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:58.828651 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-033c9678-1254-4c80-9158-02d8d31e0630 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:58.829139 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-033c9678-1254-4c80-9158-02d8d31e0630 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:59.041931 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-033c9678-1254-4c80-9158-02d8d31e0630 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:59.050912 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-033c9678-1254-4c80-9158-02d8d31e0630 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1358 microversion: 2.1 time: 0.237314 Feb 19 02:32:59.051535 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 430/885] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:32:58 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:32:59.362108 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-576dd85f-19e9-45a3-a134-23a84b9bf49b req-5c6cdb78-b63a-4366-a362-cf1bb1299a9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb5c58f3-abb6-4bda-8928-db72606dcefd", "name": "network-vif-plugged", "status": "completed", "tag": "c6e75aba-17c0-47ae-b251-61c34117a52a"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:32:59.364233 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:32:59.364233 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:32:59.373580 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-576dd85f-19e9-45a3-a134-23a84b9bf49b req-5c6cdb78-b63a-4366-a362-cf1bb1299a9e service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:59.374072 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-576dd85f-19e9-45a3-a134-23a84b9bf49b req-5c6cdb78-b63a-4366-a362-cf1bb1299a9e service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:59.391718 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-576dd85f-19e9-45a3-a134-23a84b9bf49b req-5c6cdb78-b63a-4366-a362-cf1bb1299a9e service nova] Creating event network-vif-plugged:c6e75aba-17c0-47ae-b251-61c34117a52a for instance eb5c58f3-abb6-4bda-8928-db72606dcefd on hv-cinder-77642 Feb 19 02:32:59.397405 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-576dd85f-19e9-45a3-a134-23a84b9bf49b req-5c6cdb78-b63a-4366-a362-cf1bb1299a9e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039225 Feb 19 02:32:59.398037 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 456/886] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:32:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:32:59.616815 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-cb6b2e4d-8d35-4a01-ab82-cb7a8efa6d88 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:32:59.617740 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-cb6b2e4d-8d35-4a01-ab82-cb7a8efa6d88 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:32:59.625609 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cb6b2e4d-8d35-4a01-ab82-cb7a8efa6d88 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:59.626097 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cb6b2e4d-8d35-4a01-ab82-cb7a8efa6d88 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:59.627173 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cb6b2e4d-8d35-4a01-ab82-cb7a8efa6d88 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:32:59.627801 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cb6b2e4d-8d35-4a01-ab82-cb7a8efa6d88 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:32:59.841107 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-cb6b2e4d-8d35-4a01-ab82-cb7a8efa6d88 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:59.850328 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-cb6b2e4d-8d35-4a01-ab82-cb7a8efa6d88 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:59.851912 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-cb6b2e4d-8d35-4a01-ab82-cb7a8efa6d88 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:32:59.853117 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-cb6b2e4d-8d35-4a01-ab82-cb7a8efa6d88 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1729 microversion: 2.20 time: 0.240998 Feb 19 02:32:59.853736 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 431/887] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:32:59 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1729 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:33:00.069943 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-77c892f3-25ea-4fa5-af64-844ce9376ca6 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:00.070729 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-77c892f3-25ea-4fa5-af64-844ce9376ca6 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:00.079187 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-77c892f3-25ea-4fa5-af64-844ce9376ca6 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:00.079689 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-77c892f3-25ea-4fa5-af64-844ce9376ca6 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:00.080510 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-77c892f3-25ea-4fa5-af64-844ce9376ca6 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:00.080997 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-77c892f3-25ea-4fa5-af64-844ce9376ca6 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:00.295145 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-77c892f3-25ea-4fa5-af64-844ce9376ca6 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:00.304874 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-77c892f3-25ea-4fa5-af64-844ce9376ca6 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1358 microversion: 2.1 time: 0.239516 Feb 19 02:33:00.305629 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 457/888] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:00 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:00.874212 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-acc8e4fe-97ce-455d-aa74-fd40fd9240ca tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:00.875594 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-acc8e4fe-97ce-455d-aa74-fd40fd9240ca tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:00.884855 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-acc8e4fe-97ce-455d-aa74-fd40fd9240ca tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:00.885542 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-acc8e4fe-97ce-455d-aa74-fd40fd9240ca tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:00.886424 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-acc8e4fe-97ce-455d-aa74-fd40fd9240ca tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:00.886927 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-acc8e4fe-97ce-455d-aa74-fd40fd9240ca tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:01.252136 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-acc8e4fe-97ce-455d-aa74-fd40fd9240ca tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:01.261532 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-acc8e4fe-97ce-455d-aa74-fd40fd9240ca tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:01.263117 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-acc8e4fe-97ce-455d-aa74-fd40fd9240ca tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:01.264341 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-acc8e4fe-97ce-455d-aa74-fd40fd9240ca tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1729 microversion: 2.20 time: 0.394978 Feb 19 02:33:01.265002 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 432/889] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:33:00 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1729 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:33:01.322877 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-44eb80ce-422f-497e-8b46-4b9540b133cf tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:01.323543 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-44eb80ce-422f-497e-8b46-4b9540b133cf tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:01.332687 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-44eb80ce-422f-497e-8b46-4b9540b133cf tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:01.333200 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-44eb80ce-422f-497e-8b46-4b9540b133cf tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:01.334046 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-44eb80ce-422f-497e-8b46-4b9540b133cf tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:01.334604 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-44eb80ce-422f-497e-8b46-4b9540b133cf tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:01.459485 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-4bd2cf94-b28d-4ad0-a679-152799083b0a req-83946c76-efbc-4bec-98e7-d955688621d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec6a4f24-919b-4160-9c5f-07d6513e1e08", "name": "network-vif-plugged", "status": "completed", "tag": "2d39a22b-39a7-4bd0-b9ae-911a223833df"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:33:01.461120 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:33:01.461120 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:33:01.469923 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-4bd2cf94-b28d-4ad0-a679-152799083b0a req-83946c76-efbc-4bec-98e7-d955688621d5 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:01.470445 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-4bd2cf94-b28d-4ad0-a679-152799083b0a req-83946c76-efbc-4bec-98e7-d955688621d5 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:01.488073 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-4bd2cf94-b28d-4ad0-a679-152799083b0a req-83946c76-efbc-4bec-98e7-d955688621d5 service nova] Creating event network-vif-plugged:2d39a22b-39a7-4bd0-b9ae-911a223833df for instance ec6a4f24-919b-4160-9c5f-07d6513e1e08 on hv-cinder-77642 Feb 19 02:33:01.493350 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-4bd2cf94-b28d-4ad0-a679-152799083b0a req-83946c76-efbc-4bec-98e7-d955688621d5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038441 Feb 19 02:33:01.494248 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 433/890] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:33:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:33:01.555806 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-44eb80ce-422f-497e-8b46-4b9540b133cf tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:01.565374 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-44eb80ce-422f-497e-8b46-4b9540b133cf tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1358 microversion: 2.1 time: 0.246597 Feb 19 02:33:01.566552 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 458/891] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:01 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:02.285649 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f2ff19ad-724b-4df1-a161-e8f18146c0a0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:02.286382 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f2ff19ad-724b-4df1-a161-e8f18146c0a0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:02.294380 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f2ff19ad-724b-4df1-a161-e8f18146c0a0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:02.294912 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f2ff19ad-724b-4df1-a161-e8f18146c0a0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:02.295746 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f2ff19ad-724b-4df1-a161-e8f18146c0a0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:02.296237 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f2ff19ad-724b-4df1-a161-e8f18146c0a0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:02.507436 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f2ff19ad-724b-4df1-a161-e8f18146c0a0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:02.516592 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f2ff19ad-724b-4df1-a161-e8f18146c0a0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:02.518160 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f2ff19ad-724b-4df1-a161-e8f18146c0a0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:02.520085 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f2ff19ad-724b-4df1-a161-e8f18146c0a0 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1716 microversion: 2.20 time: 0.239181 Feb 19 02:33:02.520691 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 434/892] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:33:02 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1716 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:33:02.585489 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e15d7f3a-3a09-483d-83ad-8c79a5d90621 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:02.586156 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e15d7f3a-3a09-483d-83ad-8c79a5d90621 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:02.593942 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e15d7f3a-3a09-483d-83ad-8c79a5d90621 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:02.594475 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e15d7f3a-3a09-483d-83ad-8c79a5d90621 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:02.595312 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e15d7f3a-3a09-483d-83ad-8c79a5d90621 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:02.595829 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e15d7f3a-3a09-483d-83ad-8c79a5d90621 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:02.805117 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e15d7f3a-3a09-483d-83ad-8c79a5d90621 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:02.814000 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e15d7f3a-3a09-483d-83ad-8c79a5d90621 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1358 microversion: 2.1 time: 0.233128 Feb 19 02:33:02.814659 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 459/893] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:02 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:03.556557 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-6ecb5726-0126-4a12-bb0f-de982672da08 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:33:03.557067 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-6ecb5726-0126-4a12-bb0f-de982672da08 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:03.564921 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6ecb5726-0126-4a12-bb0f-de982672da08 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:03.565417 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6ecb5726-0126-4a12-bb0f-de982672da08 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:03.566931 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6ecb5726-0126-4a12-bb0f-de982672da08 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:03.567413 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6ecb5726-0126-4a12-bb0f-de982672da08 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:03.627538 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.objects.instance [None req-6ecb5726-0126-4a12-bb0f-de982672da08 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lazy-loading 'flavor' on Instance uuid 900317e8-8e9d-49e0-927b-a4d30c204f2c {{(pid=98194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 02:33:03.771863 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-6ecb5726-0126-4a12-bb0f-de982672da08 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "POST /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c/action" status: 202 len: 0 microversion: 2.1 time: 0.219151 Feb 19 02:33:03.772501 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 435/894] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:33:03 2021] POST /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:33:03.781233 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-6dbb987a-2f96-4bcb-94a0-7c4e8e56b021 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:03.781905 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-6dbb987a-2f96-4bcb-94a0-7c4e8e56b021 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:03.790503 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6dbb987a-2f96-4bcb-94a0-7c4e8e56b021 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:03.791020 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6dbb987a-2f96-4bcb-94a0-7c4e8e56b021 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:03.791864 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6dbb987a-2f96-4bcb-94a0-7c4e8e56b021 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:03.792360 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6dbb987a-2f96-4bcb-94a0-7c4e8e56b021 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:03.834132 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-65d73ec5-66c3-4391-bb78-24069489539b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:03.834927 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-65d73ec5-66c3-4391-bb78-24069489539b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:03.842908 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-65d73ec5-66c3-4391-bb78-24069489539b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:03.843415 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-65d73ec5-66c3-4391-bb78-24069489539b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:03.844244 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-65d73ec5-66c3-4391-bb78-24069489539b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:03.844736 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-65d73ec5-66c3-4391-bb78-24069489539b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:04.011699 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-6dbb987a-2f96-4bcb-94a0-7c4e8e56b021 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:04.021438 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-6dbb987a-2f96-4bcb-94a0-7c4e8e56b021 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1571 microversion: 2.1 time: 0.244184 Feb 19 02:33:04.022083 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 460/895] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:03 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1571 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:04.071303 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-65d73ec5-66c3-4391-bb78-24069489539b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:04.080488 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-65d73ec5-66c3-4391-bb78-24069489539b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1547 microversion: 2.1 time: 0.251420 Feb 19 02:33:04.081108 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 436/896] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:03 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1547 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:33:04.098339 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4e63d054-5de6-44a0-b4ee-623020b63964 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:04.099055 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-4e63d054-5de6-44a0-b4ee-623020b63964 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:04.107000 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4e63d054-5de6-44a0-b4ee-623020b63964 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:04.107499 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4e63d054-5de6-44a0-b4ee-623020b63964 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:04.108383 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4e63d054-5de6-44a0-b4ee-623020b63964 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:04.108869 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4e63d054-5de6-44a0-b4ee-623020b63964 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:04.216198 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-77a39c51-6984-4c63-8b74-dfd245599853 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:04.217238 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-77a39c51-6984-4c63-8b74-dfd245599853 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:04.226050 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-77a39c51-6984-4c63-8b74-dfd245599853 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:04.226593 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-77a39c51-6984-4c63-8b74-dfd245599853 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:04.227433 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-77a39c51-6984-4c63-8b74-dfd245599853 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:04.227928 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-77a39c51-6984-4c63-8b74-dfd245599853 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:04.300596 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-77a39c51-6984-4c63-8b74-dfd245599853 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.088520 Feb 19 02:33:04.301206 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 437/897] 10.222.0.44 () {58 vars in 1292 bytes} [Fri Feb 19 02:33:04 2021] GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/os-volume_attachments => generated 371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:33:04.325628 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-4e63d054-5de6-44a0-b4ee-623020b63964 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:04.335397 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-4e63d054-5de6-44a0-b4ee-623020b63964 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1547 microversion: 2.1 time: 0.241157 Feb 19 02:33:04.336211 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 461/898] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:04 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1547 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:04.352899 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1eea1d79-9389-46b3-9d5b-1d0bb701dc2d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:04.356502 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:33:04.356502 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:33:04.357569 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-1eea1d79-9389-46b3-9d5b-1d0bb701dc2d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:04.358299 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1eea1d79-9389-46b3-9d5b-1d0bb701dc2d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Searching by: {'deleted': False, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c'} {{(pid=98194) get_all /opt/stack/nova/nova/compute/api.py:2833}} Feb 19 02:33:04.364173 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1eea1d79-9389-46b3-9d5b-1d0bb701dc2d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:04.364676 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1eea1d79-9389-46b3-9d5b-1d0bb701dc2d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:04.365538 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1eea1d79-9389-46b3-9d5b-1d0bb701dc2d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:04.366152 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1eea1d79-9389-46b3-9d5b-1d0bb701dc2d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:04.462089 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.multi_cell_list [None req-1eea1d79-9389-46b3-9d5b-1d0bb701dc2d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=98194) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:376}} Feb 19 02:33:04.557583 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1eea1d79-9389-46b3-9d5b-1d0bb701dc2d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.208756 Feb 19 02:33:04.558222 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 438/899] 10.222.0.44 () {58 vars in 1115 bytes} [Fri Feb 19 02:33:04 2021] GET /compute/v2.1/servers => generated 342 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:33:04.563752 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-0534311e-9bc7-4b6d-b824-4df8ed9db970 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:04.564298 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-0534311e-9bc7-4b6d-b824-4df8ed9db970 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:04.569358 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-0c1c6e6b-4d8b-45a0-bafa-14afc3430da5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:04.570023 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-0c1c6e6b-4d8b-45a0-bafa-14afc3430da5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:04.572842 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0534311e-9bc7-4b6d-b824-4df8ed9db970 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:04.573395 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0534311e-9bc7-4b6d-b824-4df8ed9db970 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:04.574190 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0534311e-9bc7-4b6d-b824-4df8ed9db970 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:04.574716 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0534311e-9bc7-4b6d-b824-4df8ed9db970 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:04.577942 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0c1c6e6b-4d8b-45a0-bafa-14afc3430da5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:04.578479 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0c1c6e6b-4d8b-45a0-bafa-14afc3430da5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:04.579312 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0c1c6e6b-4d8b-45a0-bafa-14afc3430da5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:04.579803 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0c1c6e6b-4d8b-45a0-bafa-14afc3430da5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:04.644805 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-0534311e-9bc7-4b6d-b824-4df8ed9db970 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/os-volume_attachments/13cfcc28-aeb8-4a69-9cec-6043c900a4f0" status: 200 len: 194 microversion: 2.1 time: 0.084483 Feb 19 02:33:04.645766 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 462/900] 10.222.0.44 () {58 vars in 1403 bytes} [Fri Feb 19 02:33:04 2021] GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/os-volume_attachments/13cfcc28-aeb8-4a69-9cec-6043c900a4f0 => generated 194 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:33:04.655666 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-3e6ea9b7-b631-4e2f-b246-e41f2710e29e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:04.656212 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-3e6ea9b7-b631-4e2f-b246-e41f2710e29e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:04.664115 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3e6ea9b7-b631-4e2f-b246-e41f2710e29e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:04.664621 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3e6ea9b7-b631-4e2f-b246-e41f2710e29e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:04.665457 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3e6ea9b7-b631-4e2f-b246-e41f2710e29e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:04.665949 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3e6ea9b7-b631-4e2f-b246-e41f2710e29e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:04.798744 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-0c1c6e6b-4d8b-45a0-bafa-14afc3430da5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:04.809325 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-0c1c6e6b-4d8b-45a0-bafa-14afc3430da5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1547 microversion: 2.1 time: 0.244296 Feb 19 02:33:04.822106 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 439/901] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:04 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1547 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:33:04.843749 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.objects.instance [None req-3e6ea9b7-b631-4e2f-b246-e41f2710e29e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lazy-loading 'services' on Instance uuid f0218d9a-e330-4ef2-8a16-e156c2e24cd3 {{(pid=98193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 02:33:05.008857 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-3e6ea9b7-b631-4e2f-b246-e41f2710e29e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/os-volume_attachments/13cfcc28-aeb8-4a69-9cec-6043c900a4f0" status: 202 len: 0 microversion: 2.1 time: 0.356832 Feb 19 02:33:05.009508 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 463/902] 10.222.0.44 () {58 vars in 1406 bytes} [Fri Feb 19 02:33:04 2021] DELETE /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/os-volume_attachments/13cfcc28-aeb8-4a69-9cec-6043c900a4f0 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 19 02:33:05.043153 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-752f2a2c-0a6c-4976-bd56-45c68085cf73 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:05.043866 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-752f2a2c-0a6c-4976-bd56-45c68085cf73 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:05.052372 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-752f2a2c-0a6c-4976-bd56-45c68085cf73 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:05.052873 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-752f2a2c-0a6c-4976-bd56-45c68085cf73 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:05.054047 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-752f2a2c-0a6c-4976-bd56-45c68085cf73 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:05.054704 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-752f2a2c-0a6c-4976-bd56-45c68085cf73 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:05.309092 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-752f2a2c-0a6c-4976-bd56-45c68085cf73 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:05.318397 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-752f2a2c-0a6c-4976-bd56-45c68085cf73 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1571 microversion: 2.1 time: 0.280376 Feb 19 02:33:05.319343 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 440/903] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:05 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1571 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:06.338744 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ef9a0d00-51da-4ed3-bbc4-f04fe2e40515 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:06.339519 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ef9a0d00-51da-4ed3-bbc4-f04fe2e40515 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:06.347549 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ef9a0d00-51da-4ed3-bbc4-f04fe2e40515 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:06.348055 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ef9a0d00-51da-4ed3-bbc4-f04fe2e40515 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:06.348892 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ef9a0d00-51da-4ed3-bbc4-f04fe2e40515 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:06.349380 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ef9a0d00-51da-4ed3-bbc4-f04fe2e40515 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:06.569949 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ef9a0d00-51da-4ed3-bbc4-f04fe2e40515 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:06.583300 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ef9a0d00-51da-4ed3-bbc4-f04fe2e40515 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1571 microversion: 2.1 time: 0.249088 Feb 19 02:33:06.583983 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 464/904] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:06 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1571 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:06.746682 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-077f39c0-d9e7-438c-a092-bbb62e4d66d0 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f58ec49d-b2a1-4303-814c-838fdb27a7b2"}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:33:06.747936 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-077f39c0-d9e7-438c-a092-bbb62e4d66d0 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:06.756525 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-077f39c0-d9e7-438c-a092-bbb62e4d66d0 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:06.757027 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-077f39c0-d9e7-438c-a092-bbb62e4d66d0 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:06.757847 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-077f39c0-d9e7-438c-a092-bbb62e4d66d0 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:06.758335 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-077f39c0-d9e7-438c-a092-bbb62e4d66d0 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:07.135603 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-077f39c0-d9e7-438c-a092-bbb62e4d66d0 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "POST /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.392729 Feb 19 02:33:07.136359 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 441/905] 10.222.0.44 () {60 vars in 1313 bytes} [Fri Feb 19 02:33:06 2021] POST /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments => generated 194 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:33:07.491144 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7e0d7dca-2365-412b-a324-83c40eed8228 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:07.491760 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7e0d7dca-2365-412b-a324-83c40eed8228 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:07.499825 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7e0d7dca-2365-412b-a324-83c40eed8228 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:07.500319 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7e0d7dca-2365-412b-a324-83c40eed8228 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:07.501147 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7e0d7dca-2365-412b-a324-83c40eed8228 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:07.501632 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7e0d7dca-2365-412b-a324-83c40eed8228 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:07.580761 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7e0d7dca-2365-412b-a324-83c40eed8228 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/os-volume_attachments/22f8b4e1-f206-43fc-a6ed-9df4d8ac91c8" status: 200 len: 194 microversion: 2.1 time: 0.096330 Feb 19 02:33:07.581554 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 465/906] 10.222.0.44 () {58 vars in 1403 bytes} [Fri Feb 19 02:33:07 2021] GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/os-volume_attachments/22f8b4e1-f206-43fc-a6ed-9df4d8ac91c8 => generated 194 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:33:07.593054 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-008e9c3b-d413-454e-ac5a-60d7cc345b59 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:07.593699 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-008e9c3b-d413-454e-ac5a-60d7cc345b59 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:07.602043 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ca8b56a9-7f31-4315-8aa5-62e0e357b70e tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:07.602755 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ca8b56a9-7f31-4315-8aa5-62e0e357b70e tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:07.603084 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-008e9c3b-d413-454e-ac5a-60d7cc345b59 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:07.603597 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-008e9c3b-d413-454e-ac5a-60d7cc345b59 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:07.604440 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-008e9c3b-d413-454e-ac5a-60d7cc345b59 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:07.604932 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-008e9c3b-d413-454e-ac5a-60d7cc345b59 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:07.610637 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ca8b56a9-7f31-4315-8aa5-62e0e357b70e tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:07.611167 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ca8b56a9-7f31-4315-8aa5-62e0e357b70e tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:07.612014 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ca8b56a9-7f31-4315-8aa5-62e0e357b70e tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:07.613103 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ca8b56a9-7f31-4315-8aa5-62e0e357b70e tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:07.788039 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.objects.instance [None req-008e9c3b-d413-454e-ac5a-60d7cc345b59 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lazy-loading 'services' on Instance uuid f0218d9a-e330-4ef2-8a16-e156c2e24cd3 {{(pid=98194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 02:33:07.829912 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ca8b56a9-7f31-4315-8aa5-62e0e357b70e tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:07.839452 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ca8b56a9-7f31-4315-8aa5-62e0e357b70e tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1571 microversion: 2.1 time: 0.242286 Feb 19 02:33:07.840129 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 466/907] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:07 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1571 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:33:07.930827 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-008e9c3b-d413-454e-ac5a-60d7cc345b59 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/os-volume_attachments/22f8b4e1-f206-43fc-a6ed-9df4d8ac91c8" status: 202 len: 0 microversion: 2.1 time: 0.342102 Feb 19 02:33:07.931546 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 442/908] 10.222.0.44 () {58 vars in 1406 bytes} [Fri Feb 19 02:33:07 2021] DELETE /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3/os-volume_attachments/22f8b4e1-f206-43fc-a6ed-9df4d8ac91c8 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:33:08.857988 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-07054b19-3c76-4011-9b8b-8362b4930975 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:08.858685 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-07054b19-3c76-4011-9b8b-8362b4930975 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:08.866626 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-07054b19-3c76-4011-9b8b-8362b4930975 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:08.867131 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-07054b19-3c76-4011-9b8b-8362b4930975 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:08.867965 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-07054b19-3c76-4011-9b8b-8362b4930975 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:08.868459 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-07054b19-3c76-4011-9b8b-8362b4930975 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:09.103247 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-07054b19-3c76-4011-9b8b-8362b4930975 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:09.115087 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-07054b19-3c76-4011-9b8b-8362b4930975 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1571 microversion: 2.1 time: 0.260664 Feb 19 02:33:09.116144 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 467/909] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:08 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1571 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:10.135176 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-2d3b8bfe-6b3c-44d7-a5d6-243893bd83c6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:10.135938 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-2d3b8bfe-6b3c-44d7-a5d6-243893bd83c6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:10.144475 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2d3b8bfe-6b3c-44d7-a5d6-243893bd83c6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:10.144976 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2d3b8bfe-6b3c-44d7-a5d6-243893bd83c6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:10.145798 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2d3b8bfe-6b3c-44d7-a5d6-243893bd83c6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:10.146283 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2d3b8bfe-6b3c-44d7-a5d6-243893bd83c6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:10.362728 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-2d3b8bfe-6b3c-44d7-a5d6-243893bd83c6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:10.371576 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-2d3b8bfe-6b3c-44d7-a5d6-243893bd83c6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1571 microversion: 2.1 time: 0.241593 Feb 19 02:33:10.372191 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 443/910] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:10 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1571 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:11.389328 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7fad80cf-8db5-4223-bb05-d5e2925bcf3b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:11.390004 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7fad80cf-8db5-4223-bb05-d5e2925bcf3b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:11.398559 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7fad80cf-8db5-4223-bb05-d5e2925bcf3b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:11.399073 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7fad80cf-8db5-4223-bb05-d5e2925bcf3b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:11.399912 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7fad80cf-8db5-4223-bb05-d5e2925bcf3b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:11.400404 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7fad80cf-8db5-4223-bb05-d5e2925bcf3b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:11.607872 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7fad80cf-8db5-4223-bb05-d5e2925bcf3b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:11.617527 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7fad80cf-8db5-4223-bb05-d5e2925bcf3b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1571 microversion: 2.1 time: 0.232207 Feb 19 02:33:11.618147 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 468/911] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:11 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1571 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:12.636165 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-172bcf61-179c-4f57-99a1-497cb8c9095b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:12.636761 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-172bcf61-179c-4f57-99a1-497cb8c9095b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:12.644985 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-172bcf61-179c-4f57-99a1-497cb8c9095b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:12.645481 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-172bcf61-179c-4f57-99a1-497cb8c9095b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:12.646295 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-172bcf61-179c-4f57-99a1-497cb8c9095b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:12.646843 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-172bcf61-179c-4f57-99a1-497cb8c9095b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:12.857873 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-172bcf61-179c-4f57-99a1-497cb8c9095b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:12.867240 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-172bcf61-179c-4f57-99a1-497cb8c9095b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1571 microversion: 2.1 time: 0.235082 Feb 19 02:33:12.867862 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 444/912] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:12 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1571 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:13.885428 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-68c7336a-23ae-4503-a1c6-e6167e147ae1 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:13.886139 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-68c7336a-23ae-4503-a1c6-e6167e147ae1 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:13.894733 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-68c7336a-23ae-4503-a1c6-e6167e147ae1 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:13.895240 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-68c7336a-23ae-4503-a1c6-e6167e147ae1 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:13.896076 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-68c7336a-23ae-4503-a1c6-e6167e147ae1 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:13.896565 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-68c7336a-23ae-4503-a1c6-e6167e147ae1 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:14.069934 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e648e5f9-8661-47d7-9e8d-7f366b661d1d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:14.070789 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e648e5f9-8661-47d7-9e8d-7f366b661d1d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:14.078857 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e648e5f9-8661-47d7-9e8d-7f366b661d1d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:14.079373 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e648e5f9-8661-47d7-9e8d-7f366b661d1d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:14.080233 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e648e5f9-8661-47d7-9e8d-7f366b661d1d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:14.080738 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e648e5f9-8661-47d7-9e8d-7f366b661d1d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:14.120980 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-68c7336a-23ae-4503-a1c6-e6167e147ae1 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:14.130580 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-68c7336a-23ae-4503-a1c6-e6167e147ae1 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1571 microversion: 2.1 time: 0.249137 Feb 19 02:33:14.131226 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 469/913] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:13 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1571 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:14.437851 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e648e5f9-8661-47d7-9e8d-7f366b661d1d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:14.447403 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e648e5f9-8661-47d7-9e8d-7f366b661d1d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1593 microversion: 2.1 time: 0.382033 Feb 19 02:33:14.448043 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 445/914] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:14 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1593 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:14.465672 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-71f7fe09-0503-4d0c-895d-b212f57befa0 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Action: 'create', calling method: .version_select at 0x7f217d730ae8>, body: {"pool": null} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:33:15.077996 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7a2bdff8-31c1-4839-8719-598b220d9190 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:15.078549 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7a2bdff8-31c1-4839-8719-598b220d9190 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:15.086286 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7a2bdff8-31c1-4839-8719-598b220d9190 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:15.086827 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7a2bdff8-31c1-4839-8719-598b220d9190 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:15.087658 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7a2bdff8-31c1-4839-8719-598b220d9190 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:15.088156 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7a2bdff8-31c1-4839-8719-598b220d9190 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:15.154938 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7a2bdff8-31c1-4839-8719-598b220d9190 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Going to try to terminate instance {{(pid=98194) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 02:33:15.269720 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7a2bdff8-31c1-4839-8719-598b220d9190 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3" status: 204 len: 0 microversion: 2.1 time: 0.195678 Feb 19 02:33:15.270392 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 446/915] 10.222.0.44 () {58 vars in 1229 bytes} [Fri Feb 19 02:33:15 2021] DELETE /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 19 02:33:15.278827 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-3ad2abfb-938d-41a4-8d2f-4f62201ee3b6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:15.279586 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-3ad2abfb-938d-41a4-8d2f-4f62201ee3b6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:15.287761 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3ad2abfb-938d-41a4-8d2f-4f62201ee3b6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:15.288268 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3ad2abfb-938d-41a4-8d2f-4f62201ee3b6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:15.289095 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3ad2abfb-938d-41a4-8d2f-4f62201ee3b6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:15.289579 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3ad2abfb-938d-41a4-8d2f-4f62201ee3b6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:15.503482 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-3ad2abfb-938d-41a4-8d2f-4f62201ee3b6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:15.512502 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-3ad2abfb-938d-41a4-8d2f-4f62201ee3b6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1571 microversion: 2.1 time: 0.240001 Feb 19 02:33:15.513125 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 447/916] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:15 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1571 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:15.517682 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-da3dca85-2866-486d-b710-518ca25e2f3c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:15.518330 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-da3dca85-2866-486d-b710-518ca25e2f3c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:15.527170 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-da3dca85-2866-486d-b710-518ca25e2f3c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:15.527740 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-da3dca85-2866-486d-b710-518ca25e2f3c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:15.528594 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-da3dca85-2866-486d-b710-518ca25e2f3c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:15.529085 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-da3dca85-2866-486d-b710-518ca25e2f3c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:15.744821 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-da3dca85-2866-486d-b710-518ca25e2f3c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:15.756137 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-da3dca85-2866-486d-b710-518ca25e2f3c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3" status: 200 len: 1669 microversion: 2.1 time: 0.241934 Feb 19 02:33:15.756870 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 448/917] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:15 2021] GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3 => generated 1669 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:16.531336 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ba48483b-d7d5-451d-a8f8-3c1c08fb0dec tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:16.532007 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ba48483b-d7d5-451d-a8f8-3c1c08fb0dec tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:16.540413 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ba48483b-d7d5-451d-a8f8-3c1c08fb0dec tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:16.540917 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ba48483b-d7d5-451d-a8f8-3c1c08fb0dec tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:16.541742 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ba48483b-d7d5-451d-a8f8-3c1c08fb0dec tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:16.542210 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ba48483b-d7d5-451d-a8f8-3c1c08fb0dec tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:16.723659 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-71f7fe09-0503-4d0c-895d-b212f57befa0 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.261984 Feb 19 02:33:16.724582 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 470/918] 10.222.0.44 () {60 vars in 1160 bytes} [Fri Feb 19 02:33:14 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:33:16.739591 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-92d301ed-f215-494f-9e63-56303d0f94a5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.1.59"}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:33:16.740872 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-92d301ed-f215-494f-9e63-56303d0f94a5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:16.748975 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-92d301ed-f215-494f-9e63-56303d0f94a5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:16.749476 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-92d301ed-f215-494f-9e63-56303d0f94a5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:16.750316 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-92d301ed-f215-494f-9e63-56303d0f94a5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:16.750827 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-92d301ed-f215-494f-9e63-56303d0f94a5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:16.766322 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ba48483b-d7d5-451d-a8f8-3c1c08fb0dec tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:16.776770 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ba48483b-d7d5-451d-a8f8-3c1c08fb0dec tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1571 microversion: 2.1 time: 0.249425 Feb 19 02:33:16.777476 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 449/919] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:16 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1571 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:33:16.781941 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5413b012-062a-4c81-896e-07372c41672f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:16.782816 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5413b012-062a-4c81-896e-07372c41672f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:16.792129 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5413b012-062a-4c81-896e-07372c41672f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:16.792794 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5413b012-062a-4c81-896e-07372c41672f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:16.793642 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5413b012-062a-4c81-896e-07372c41672f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:16.794134 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5413b012-062a-4c81-896e-07372c41672f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:16.820251 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-92d301ed-f215-494f-9e63-56303d0f94a5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Acquired lock "refresh_cache-ec6a4f24-919b-4160-9c5f-07d6513e1e08" {{(pid=98193) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 19 02:33:17.013392 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5413b012-062a-4c81-896e-07372c41672f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:17.038077 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5413b012-062a-4c81-896e-07372c41672f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3" status: 200 len: 1669 microversion: 2.1 time: 0.259611 Feb 19 02:33:17.039048 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 450/920] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:16 2021] GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3 => generated 1669 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:17.795406 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c05c0590-a2e9-4fdb-9ccc-8145e6943461 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:17.796163 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c05c0590-a2e9-4fdb-9ccc-8145e6943461 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:17.804287 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c05c0590-a2e9-4fdb-9ccc-8145e6943461 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:17.804870 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c05c0590-a2e9-4fdb-9ccc-8145e6943461 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:17.805769 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c05c0590-a2e9-4fdb-9ccc-8145e6943461 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:17.806309 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c05c0590-a2e9-4fdb-9ccc-8145e6943461 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:18.231701 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c05c0590-a2e9-4fdb-9ccc-8145e6943461 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:18.241292 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c05c0590-a2e9-4fdb-9ccc-8145e6943461 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1512 microversion: 2.1 time: 0.449715 Feb 19 02:33:18.241944 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 451/921] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:17 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1512 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:33:18.247384 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c313de56-8bdd-4046-a72b-fd2f5a74c094 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:18.248061 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c313de56-8bdd-4046-a72b-fd2f5a74c094 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:18.257257 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c313de56-8bdd-4046-a72b-fd2f5a74c094 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:18.258284 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c313de56-8bdd-4046-a72b-fd2f5a74c094 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:18.258657 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c313de56-8bdd-4046-a72b-fd2f5a74c094 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:18.259136 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c313de56-8bdd-4046-a72b-fd2f5a74c094 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:18.674190 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c313de56-8bdd-4046-a72b-fd2f5a74c094 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:18.683772 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c313de56-8bdd-4046-a72b-fd2f5a74c094 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3" status: 200 len: 1602 microversion: 2.1 time: 0.440289 Feb 19 02:33:18.684567 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 452/922] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:18 2021] GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3 => generated 1602 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:18.696952 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ca0a6d08-a174-4b56-96ae-725ef4eeee8b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:33:18.697670 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ca0a6d08-a174-4b56-96ae-725ef4eeee8b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:18.707447 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ca0a6d08-a174-4b56-96ae-725ef4eeee8b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:18.707447 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ca0a6d08-a174-4b56-96ae-725ef4eeee8b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:18.708252 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ca0a6d08-a174-4b56-96ae-725ef4eeee8b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:18.708842 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ca0a6d08-a174-4b56-96ae-725ef4eeee8b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:18.867897 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-92d301ed-f215-494f-9e63-56303d0f94a5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Building network info cache for instance {{(pid=98193) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 19 02:33:18.888438 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ca0a6d08-a174-4b56-96ae-725ef4eeee8b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "POST /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c/action" status: 202 len: 0 microversion: 2.1 time: 0.196208 Feb 19 02:33:18.889771 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 453/923] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:33:18 2021] POST /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:33:18.896293 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-08aa6447-a359-4781-ac88-ff351e5b7193 req-feee140a-0787-41c6-afb0-4c3fea6e6bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "900317e8-8e9d-49e0-927b-a4d30c204f2c", "name": "network-vif-unplugged", "status": "completed", "tag": "9b55214e-d4a5-4d7f-a090-48b12fdd6991"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:33:18.899661 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:33:18.899661 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:33:18.915196 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-08aa6447-a359-4781-ac88-ff351e5b7193 req-feee140a-0787-41c6-afb0-4c3fea6e6bc2 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:18.915712 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-08aa6447-a359-4781-ac88-ff351e5b7193 req-feee140a-0787-41c6-afb0-4c3fea6e6bc2 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:18.947693 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.compute.server_external_events [req-08aa6447-a359-4781-ac88-ff351e5b7193 req-feee140a-0787-41c6-afb0-4c3fea6e6bc2 service nova] Unable to find a host for instance 900317e8-8e9d-49e0-927b-a4d30c204f2c. Dropping event network-vif-unplugged {{(pid=98194) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:141}} Feb 19 02:33:18.948814 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-08aa6447-a359-4781-ac88-ff351e5b7193 req-feee140a-0787-41c6-afb0-4c3fea6e6bc2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.057834 Feb 19 02:33:18.950345 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 454/924] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:33:18 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 59 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 19 02:33:19.016887 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-5dff64d4-96df-455f-a947-5e87e9ddcbaf req-60f78858-edd5-46ac-970f-335f2c8162ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec6a4f24-919b-4160-9c5f-07d6513e1e08", "tag": "2d39a22b-39a7-4bd0-b9ae-911a223833df"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:33:19.018857 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:33:19.018857 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:33:19.029108 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-5dff64d4-96df-455f-a947-5e87e9ddcbaf req-60f78858-edd5-46ac-970f-335f2c8162ab service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:19.029824 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-5dff64d4-96df-455f-a947-5e87e9ddcbaf req-60f78858-edd5-46ac-970f-335f2c8162ab service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:19.053142 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-5dff64d4-96df-455f-a947-5e87e9ddcbaf req-60f78858-edd5-46ac-970f-335f2c8162ab service nova] Creating event network-changed:2d39a22b-39a7-4bd0-b9ae-911a223833df for instance ec6a4f24-919b-4160-9c5f-07d6513e1e08 on hv-cinder-77642 Feb 19 02:33:19.058956 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-5dff64d4-96df-455f-a947-5e87e9ddcbaf req-60f78858-edd5-46ac-970f-335f2c8162ab service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107262 Feb 19 02:33:19.059906 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 455/925] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:33:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:33:19.065947 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b721cd1e-25eb-44a9-b35e-8228821d1d5b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:19.066918 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b721cd1e-25eb-44a9-b35e-8228821d1d5b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:19.078132 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b721cd1e-25eb-44a9-b35e-8228821d1d5b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:19.079477 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b721cd1e-25eb-44a9-b35e-8228821d1d5b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:19.080580 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b721cd1e-25eb-44a9-b35e-8228821d1d5b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:19.081381 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b721cd1e-25eb-44a9-b35e-8228821d1d5b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:19.468097 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b721cd1e-25eb-44a9-b35e-8228821d1d5b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:19.478997 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b721cd1e-25eb-44a9-b35e-8228821d1d5b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1520 microversion: 2.1 time: 0.417224 Feb 19 02:33:19.479801 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 456/926] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:19 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1520 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:19.484878 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-d1c19533-4404-4afc-bb0c-5e906e65e413 req-be2e8026-6d03-42aa-a4c5-9f7a02730cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0218d9a-e330-4ef2-8a16-e156c2e24cd3", "name": "network-vif-deleted", "tag": "d739dca4-9cc8-47ad-84ac-4ada4b45be64"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:33:19.486521 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:33:19.486521 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:33:19.496265 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-d1c19533-4404-4afc-bb0c-5e906e65e413 req-be2e8026-6d03-42aa-a4c5-9f7a02730cc4 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:19.496823 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-d1c19533-4404-4afc-bb0c-5e906e65e413 req-be2e8026-6d03-42aa-a4c5-9f7a02730cc4 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:19.525564 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-d1c19533-4404-4afc-bb0c-5e906e65e413 req-be2e8026-6d03-42aa-a4c5-9f7a02730cc4 service nova] Creating event network-vif-deleted:d739dca4-9cc8-47ad-84ac-4ada4b45be64 for instance f0218d9a-e330-4ef2-8a16-e156c2e24cd3 on hv-cinder-77642 Feb 19 02:33:19.556950 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-d1c19533-4404-4afc-bb0c-5e906e65e413 req-be2e8026-6d03-42aa-a4c5-9f7a02730cc4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056036 Feb 19 02:33:19.557852 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 457/927] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:33:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:33:19.704167 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b813b2ad-8bf0-4f45-8695-35809cfd8912 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:19.704933 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b813b2ad-8bf0-4f45-8695-35809cfd8912 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:19.714574 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b813b2ad-8bf0-4f45-8695-35809cfd8912 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:19.714900 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b813b2ad-8bf0-4f45-8695-35809cfd8912 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:19.716250 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b813b2ad-8bf0-4f45-8695-35809cfd8912 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:19.716749 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b813b2ad-8bf0-4f45-8695-35809cfd8912 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:19.810614 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b813b2ad-8bf0-4f45-8695-35809cfd8912 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:19.811115 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b813b2ad-8bf0-4f45-8695-35809cfd8912 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:19.811626 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.objects.instance [None req-b813b2ad-8bf0-4f45-8695-35809cfd8912 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lazy-loading 'fault' on Instance uuid f0218d9a-e330-4ef2-8a16-e156c2e24cd3 {{(pid=98194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 02:33:19.915545 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-b813b2ad-8bf0-4f45-8695-35809cfd8912 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f95ba89e87bd4588a0c6c3593a6a4071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3f0058e9cc413c9235ce9b044f5d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:19.925253 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b813b2ad-8bf0-4f45-8695-35809cfd8912 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3" status: 200 len: 1325 microversion: 2.1 time: 0.225884 Feb 19 02:33:19.925879 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 458/928] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:19 2021] GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3 => generated 1325 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:33:20.497556 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-aa64c0e9-a09f-45c3-842a-19b718a52a2c tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:20.499003 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-aa64c0e9-a09f-45c3-842a-19b718a52a2c tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:20.508381 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-aa64c0e9-a09f-45c3-842a-19b718a52a2c tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:20.508977 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-aa64c0e9-a09f-45c3-842a-19b718a52a2c tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:20.510090 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-aa64c0e9-a09f-45c3-842a-19b718a52a2c tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:20.510776 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-aa64c0e9-a09f-45c3-842a-19b718a52a2c tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:20.747691 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-aa64c0e9-a09f-45c3-842a-19b718a52a2c tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:20.756883 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-aa64c0e9-a09f-45c3-842a-19b718a52a2c tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1522 microversion: 2.1 time: 0.263313 Feb 19 02:33:20.769078 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 459/929] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:20 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:33:20.784658 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-92d301ed-f215-494f-9e63-56303d0f94a5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Updating instance_info_cache with network_info: [{"id": "2d39a22b-39a7-4bd0-b9ae-911a223833df", "address": "fa:16:3e:76:8d:46", "network": {"id": "44a41470-32cc-4220-b6d8-4fa5cdef8de0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-576736226-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.1.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ed76decd92fc4f23bf841fd8f151e05c", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap2d39a22b-39", "ovs_interfaceid": "2d39a22b-39a7-4bd0-b9ae-911a223833df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98193) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 19 02:33:20.796515 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-92d301ed-f215-494f-9e63-56303d0f94a5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Releasing lock "refresh_cache-ec6a4f24-919b-4160-9c5f-07d6513e1e08" {{(pid=98193) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 19 02:33:20.797453 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-92d301ed-f215-494f-9e63-56303d0f94a5 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "POST /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/action" status: 202 len: 0 microversion: 2.1 time: 4.061909 Feb 19 02:33:20.798481 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 471/930] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:33:16 2021] POST /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/action => generated 0 bytes in 4063 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 19 02:33:20.810273 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8a0ac32e-3b53-4151-8a07-3674e69628cb tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Action: 'create', calling method: .version_select at 0x7f217c1a88c8>, body: {"security_group": {"name": "tempest-TestMinimumBasicScenario-1734754259", "description": "tempest-TestMinimumBasicScenario-1734754259 description"}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:33:20.945521 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b2fdfd28-9769-4f84-b1fc-00fe3d87db2e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:20.946197 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b2fdfd28-9769-4f84-b1fc-00fe3d87db2e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:20.969156 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b2fdfd28-9769-4f84-b1fc-00fe3d87db2e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:20.974077 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b2fdfd28-9769-4f84-b1fc-00fe3d87db2e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:20.975229 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b2fdfd28-9769-4f84-b1fc-00fe3d87db2e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:20.975933 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b2fdfd28-9769-4f84-b1fc-00fe3d87db2e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:21.059823 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-b2fdfd28-9769-4f84-b1fc-00fe3d87db2e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] HTTP exception thrown: Instance f0218d9a-e330-4ef2-8a16-e156c2e24cd3 could not be found. Feb 19 02:33:21.061038 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b2fdfd28-9769-4f84-b1fc-00fe3d87db2e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Returning 404 to user: Instance f0218d9a-e330-4ef2-8a16-e156c2e24cd3 could not be found. {{(pid=98193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:33:21.062156 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b2fdfd28-9769-4f84-b1fc-00fe3d87db2e tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3" status: 404 len: 111 microversion: 2.1 time: 0.121595 Feb 19 02:33:21.067300 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 472/931] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:20 2021] GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 02:33:21.075719 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ecc3cfd4-f94c-44f7-8506-70c5f9ac2fe5 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '.version_select at 0x7f217cde97b8>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:21.101053 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ecc3cfd4-f94c-44f7-8506-70c5f9ac2fe5 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-53938536" status: 202 len: 0 microversion: 2.1 time: 0.032313 Feb 19 02:33:21.102163 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 473/932] 10.222.0.44 () {58 vars in 1205 bytes} [Fri Feb 19 02:33:21 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-53938536 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:33:21.131341 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8a0ac32e-3b53-4151-8a07-3674e69628cb tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "POST /compute/v2.1/os-security-groups" status: 200 len: 257 microversion: 2.1 time: 0.327882 Feb 19 02:33:21.131967 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 460/933] 10.222.0.44 () {60 vars in 1170 bytes} [Fri Feb 19 02:33:20 2021] POST /compute/v2.1/os-security-groups => generated 257 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:33:21.144886 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-24d661ae-e9d2-47e9-a50e-b0102ae2f046 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Action: 'create', calling method: .version_select at 0x7f217cde9840>, body: {"security_group_rule": {"parent_group_id": "c3045f51-a241-4ad3-81a3-c9120a6b039a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:33:21.775619 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-17e2e7da-5e01-47b6-aeb8-6cdec62125cf tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:21.776293 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-17e2e7da-5e01-47b6-aeb8-6cdec62125cf tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:21.784782 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-17e2e7da-5e01-47b6-aeb8-6cdec62125cf tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:21.785411 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-17e2e7da-5e01-47b6-aeb8-6cdec62125cf tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:21.786259 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-17e2e7da-5e01-47b6-aeb8-6cdec62125cf tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:21.786780 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-17e2e7da-5e01-47b6-aeb8-6cdec62125cf tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:22.025214 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-17e2e7da-5e01-47b6-aeb8-6cdec62125cf tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:22.032806 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-17e2e7da-5e01-47b6-aeb8-6cdec62125cf tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1522 microversion: 2.1 time: 0.261190 Feb 19 02:33:22.033557 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 461/934] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:21 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:33:22.046456 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-24d661ae-e9d2-47e9-a50e-b0102ae2f046 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.906491 Feb 19 02:33:22.047115 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 474/935] 10.222.0.44 () {60 vars in 1185 bytes} [Fri Feb 19 02:33:21 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:33:22.059453 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-732c55dc-0aab-4401-8519-9462c234b118 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Action: 'create', calling method: .version_select at 0x7f217c0ef950>, body: {"security_group_rule": {"parent_group_id": "c3045f51-a241-4ad3-81a3-c9120a6b039a", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:33:22.830347 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-732c55dc-0aab-4401-8519-9462c234b118 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.775062 Feb 19 02:33:22.831848 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 462/936] 10.222.0.44 () {60 vars in 1185 bytes} [Fri Feb 19 02:33:22 2021] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:33:22.843108 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-37f15c01-21a5-4d17-b21f-ae464c6c5213 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-TestMinimumBasicScenario-1734754259"}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:33:22.843760 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-37f15c01-21a5-4d17-b21f-ae464c6c5213 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:22.852470 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-37f15c01-21a5-4d17-b21f-ae464c6c5213 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:22.852983 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-37f15c01-21a5-4d17-b21f-ae464c6c5213 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:22.853827 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-37f15c01-21a5-4d17-b21f-ae464c6c5213 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:22.854328 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-37f15c01-21a5-4d17-b21f-ae464c6c5213 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:23.053500 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-104abe3b-875a-4581-a818-db199288478b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:23.054307 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-104abe3b-875a-4581-a818-db199288478b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:23.062581 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-104abe3b-875a-4581-a818-db199288478b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:23.063149 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-104abe3b-875a-4581-a818-db199288478b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:23.064193 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-104abe3b-875a-4581-a818-db199288478b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:23.064683 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-104abe3b-875a-4581-a818-db199288478b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:23.073971 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.network.security_group_api [None req-37f15c01-21a5-4d17-b21f-ae464c6c5213 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Adding security group c3045f51-a241-4ad3-81a3-c9120a6b039a to port 2d39a22b-39a7-4bd0-b9ae-911a223833df Feb 19 02:33:23.311794 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-104abe3b-875a-4581-a818-db199288478b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:23.321810 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-104abe3b-875a-4581-a818-db199288478b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1578 microversion: 2.1 time: 0.273992 Feb 19 02:33:23.322815 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 463/937] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:23 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1578 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:23.822345 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-37f15c01-21a5-4d17-b21f-ae464c6c5213 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "POST /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/action" status: 202 len: 0 microversion: 2.1 time: 0.983386 Feb 19 02:33:23.823277 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 475/938] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:33:22 2021] POST /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/action => generated 0 bytes in 985 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:33:23.831336 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-7c98a65c-afd4-4175-9178-206df47dd6d5 req-784fa417-de2a-4cb7-8be0-e93e9495af20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec6a4f24-919b-4160-9c5f-07d6513e1e08", "tag": "2d39a22b-39a7-4bd0-b9ae-911a223833df"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:33:23.831565 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-cd4812a7-9f0d-4765-a4bb-5a52f8188326 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:23.832440 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-cd4812a7-9f0d-4765-a4bb-5a52f8188326 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:23.833076 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:33:23.833076 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:33:23.840654 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cd4812a7-9f0d-4765-a4bb-5a52f8188326 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:23.841164 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cd4812a7-9f0d-4765-a4bb-5a52f8188326 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:23.842023 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cd4812a7-9f0d-4765-a4bb-5a52f8188326 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:23.842610 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cd4812a7-9f0d-4765-a4bb-5a52f8188326 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:23.842745 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-7c98a65c-afd4-4175-9178-206df47dd6d5 req-784fa417-de2a-4cb7-8be0-e93e9495af20 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:23.843111 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-7c98a65c-afd4-4175-9178-206df47dd6d5 req-784fa417-de2a-4cb7-8be0-e93e9495af20 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:23.861907 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-7c98a65c-afd4-4175-9178-206df47dd6d5 req-784fa417-de2a-4cb7-8be0-e93e9495af20 service nova] Creating event network-changed:2d39a22b-39a7-4bd0-b9ae-911a223833df for instance ec6a4f24-919b-4160-9c5f-07d6513e1e08 on hv-cinder-77642 Feb 19 02:33:23.867762 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-7c98a65c-afd4-4175-9178-206df47dd6d5 req-784fa417-de2a-4cb7-8be0-e93e9495af20 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040775 Feb 19 02:33:23.870535 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 464/939] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:33:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:33:24.217602 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-cd4812a7-9f0d-4765-a4bb-5a52f8188326 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:24.227740 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-cd4812a7-9f0d-4765-a4bb-5a52f8188326 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1768 microversion: 2.1 time: 0.400220 Feb 19 02:33:24.228377 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 476/940] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:23 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1768 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:33:24.341613 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-855066f8-3936-40a4-8892-2b5ce0d5f755 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:24.342401 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-855066f8-3936-40a4-8892-2b5ce0d5f755 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:24.351186 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-855066f8-3936-40a4-8892-2b5ce0d5f755 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:24.351693 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-855066f8-3936-40a4-8892-2b5ce0d5f755 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:24.352523 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-855066f8-3936-40a4-8892-2b5ce0d5f755 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:24.353143 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-855066f8-3936-40a4-8892-2b5ce0d5f755 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:24.571345 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-855066f8-3936-40a4-8892-2b5ce0d5f755 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:24.581862 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-855066f8-3936-40a4-8892-2b5ce0d5f755 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1578 microversion: 2.1 time: 0.244536 Feb 19 02:33:24.583043 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 465/941] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:24 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1578 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:25.601419 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-eb2ec7bc-37c9-4e97-b06a-4c0c17583b18 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:25.602125 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-eb2ec7bc-37c9-4e97-b06a-4c0c17583b18 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:25.610075 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-eb2ec7bc-37c9-4e97-b06a-4c0c17583b18 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:25.610610 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-eb2ec7bc-37c9-4e97-b06a-4c0c17583b18 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:25.611448 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-eb2ec7bc-37c9-4e97-b06a-4c0c17583b18 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:25.611938 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-eb2ec7bc-37c9-4e97-b06a-4c0c17583b18 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:25.676536 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-2fb46e76-1687-4f4e-b11a-109fb39a777f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:25.677086 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-2fb46e76-1687-4f4e-b11a-109fb39a777f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:25.685480 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2fb46e76-1687-4f4e-b11a-109fb39a777f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:25.685982 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2fb46e76-1687-4f4e-b11a-109fb39a777f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:25.686899 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2fb46e76-1687-4f4e-b11a-109fb39a777f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:25.687380 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2fb46e76-1687-4f4e-b11a-109fb39a777f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:25.741217 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-2fb46e76-1687-4f4e-b11a-109fb39a777f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] HTTP exception thrown: Instance f0218d9a-e330-4ef2-8a16-e156c2e24cd3 could not be found. Feb 19 02:33:25.741877 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-2fb46e76-1687-4f4e-b11a-109fb39a777f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Returning 404 to user: Instance f0218d9a-e330-4ef2-8a16-e156c2e24cd3 could not be found. {{(pid=98194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:33:25.742804 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-2fb46e76-1687-4f4e-b11a-109fb39a777f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3" status: 404 len: 111 microversion: 2.1 time: 0.070993 Feb 19 02:33:25.743420 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 466/942] 10.222.0.44 () {58 vars in 1229 bytes} [Fri Feb 19 02:33:25 2021] DELETE /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 02:33:25.751530 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1df51936-015c-467e-90d1-1fdc7167e47c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:25.752188 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1df51936-015c-467e-90d1-1fdc7167e47c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: f0218d9a-e330-4ef2-8a16-e156c2e24cd3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:25.759948 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1df51936-015c-467e-90d1-1fdc7167e47c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:25.760449 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1df51936-015c-467e-90d1-1fdc7167e47c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:25.761259 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1df51936-015c-467e-90d1-1fdc7167e47c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:25.761740 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1df51936-015c-467e-90d1-1fdc7167e47c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:25.817805 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-1df51936-015c-467e-90d1-1fdc7167e47c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] HTTP exception thrown: Instance f0218d9a-e330-4ef2-8a16-e156c2e24cd3 could not be found. Feb 19 02:33:25.818499 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1df51936-015c-467e-90d1-1fdc7167e47c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Returning 404 to user: Instance f0218d9a-e330-4ef2-8a16-e156c2e24cd3 could not be found. {{(pid=98194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:33:25.819401 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1df51936-015c-467e-90d1-1fdc7167e47c tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3" status: 404 len: 111 microversion: 2.1 time: 0.071568 Feb 19 02:33:25.820017 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 467/943] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:25 2021] GET /compute/v2.1/servers/f0218d9a-e330-4ef2-8a16-e156c2e24cd3 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 02:33:25.829423 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-eb2ec7bc-37c9-4e97-b06a-4c0c17583b18 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:25.838700 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-eb2ec7bc-37c9-4e97-b06a-4c0c17583b18 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1578 microversion: 2.1 time: 0.241760 Feb 19 02:33:25.839332 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 477/944] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:25 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1578 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:26.857592 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f877a6d9-9737-4d60-b63a-1758226d8a62 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:26.858302 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f877a6d9-9737-4d60-b63a-1758226d8a62 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:26.866160 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f877a6d9-9737-4d60-b63a-1758226d8a62 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:26.866694 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f877a6d9-9737-4d60-b63a-1758226d8a62 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:26.867524 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f877a6d9-9737-4d60-b63a-1758226d8a62 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:26.868018 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f877a6d9-9737-4d60-b63a-1758226d8a62 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:27.063998 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1e10c778-11b5-4bf2-8ae0-470bb08cd644 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:27.064556 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1e10c778-11b5-4bf2-8ae0-470bb08cd644 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:27.073013 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1e10c778-11b5-4bf2-8ae0-470bb08cd644 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:27.073520 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1e10c778-11b5-4bf2-8ae0-470bb08cd644 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:27.074383 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1e10c778-11b5-4bf2-8ae0-470bb08cd644 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:27.074895 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1e10c778-11b5-4bf2-8ae0-470bb08cd644 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:27.078771 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f877a6d9-9737-4d60-b63a-1758226d8a62 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:27.088469 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f877a6d9-9737-4d60-b63a-1758226d8a62 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1578 microversion: 2.1 time: 0.234885 Feb 19 02:33:27.089092 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 468/945] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:26 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1578 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:27.128496 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-1e10c778-11b5-4bf2-8ae0-470bb08cd644 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] HTTP exception thrown: Instance 42f746d8-04b6-4db3-a823-ecff5e8dab6b could not be found. Feb 19 02:33:27.129103 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1e10c778-11b5-4bf2-8ae0-470bb08cd644 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Returning 404 to user: Instance 42f746d8-04b6-4db3-a823-ecff5e8dab6b could not be found. {{(pid=98193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:33:27.130015 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1e10c778-11b5-4bf2-8ae0-470bb08cd644 tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "DELETE /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 404 len: 111 microversion: 2.1 time: 0.070047 Feb 19 02:33:27.130679 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 478/946] 10.222.0.44 () {58 vars in 1229 bytes} [Fri Feb 19 02:33:27 2021] DELETE /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 02:33:27.139097 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4c506d6a-4be0-4b58-93df-000032b8386f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:27.139770 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-4c506d6a-4be0-4b58-93df-000032b8386f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] [instance: 42f746d8-04b6-4db3-a823-ecff5e8dab6b] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:27.149703 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4c506d6a-4be0-4b58-93df-000032b8386f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:27.150630 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4c506d6a-4be0-4b58-93df-000032b8386f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:27.152553 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4c506d6a-4be0-4b58-93df-000032b8386f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:27.152553 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4c506d6a-4be0-4b58-93df-000032b8386f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:27.205411 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-4c506d6a-4be0-4b58-93df-000032b8386f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] HTTP exception thrown: Instance 42f746d8-04b6-4db3-a823-ecff5e8dab6b could not be found. Feb 19 02:33:27.206661 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4c506d6a-4be0-4b58-93df-000032b8386f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] Returning 404 to user: Instance 42f746d8-04b6-4db3-a823-ecff5e8dab6b could not be found. {{(pid=98194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:33:27.207568 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-4c506d6a-4be0-4b58-93df-000032b8386f tempest-AttachVolumeTestJSON-77154404 tempest-AttachVolumeTestJSON-77154404-project] 10.222.0.44 "GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b" status: 404 len: 111 microversion: 2.1 time: 0.072484 Feb 19 02:33:27.208584 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 469/947] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:27 2021] GET /compute/v2.1/servers/42f746d8-04b6-4db3-a823-ecff5e8dab6b => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 02:33:28.106626 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c787e4df-3774-4950-830f-6e6503d036f1 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:28.107293 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c787e4df-3774-4950-830f-6e6503d036f1 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:28.115748 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c787e4df-3774-4950-830f-6e6503d036f1 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:28.116247 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c787e4df-3774-4950-830f-6e6503d036f1 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:28.117091 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c787e4df-3774-4950-830f-6e6503d036f1 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:28.117573 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c787e4df-3774-4950-830f-6e6503d036f1 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:28.332516 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c787e4df-3774-4950-830f-6e6503d036f1 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:28.341474 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c787e4df-3774-4950-830f-6e6503d036f1 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1578 microversion: 2.1 time: 0.238904 Feb 19 02:33:28.342093 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 479/948] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:28 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1578 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:29.359649 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7888bac3-70f6-4264-b58f-0647252eb846 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:29.360338 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7888bac3-70f6-4264-b58f-0647252eb846 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:29.368358 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7888bac3-70f6-4264-b58f-0647252eb846 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:29.368864 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7888bac3-70f6-4264-b58f-0647252eb846 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:29.369715 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7888bac3-70f6-4264-b58f-0647252eb846 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:29.370204 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7888bac3-70f6-4264-b58f-0647252eb846 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:29.773261 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7888bac3-70f6-4264-b58f-0647252eb846 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:29.782216 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7888bac3-70f6-4264-b58f-0647252eb846 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1578 microversion: 2.1 time: 0.426554 Feb 19 02:33:29.783023 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 470/949] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:29 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1578 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:30.801658 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f4c7d5de-ac20-455b-9265-cec4df4e5366 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:30.802329 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f4c7d5de-ac20-455b-9265-cec4df4e5366 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:30.810548 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f4c7d5de-ac20-455b-9265-cec4df4e5366 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:30.811056 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f4c7d5de-ac20-455b-9265-cec4df4e5366 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:30.811894 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f4c7d5de-ac20-455b-9265-cec4df4e5366 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:30.812377 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f4c7d5de-ac20-455b-9265-cec4df4e5366 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:31.043729 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f4c7d5de-ac20-455b-9265-cec4df4e5366 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:31.054316 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f4c7d5de-ac20-455b-9265-cec4df4e5366 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1578 microversion: 2.1 time: 0.257265 Feb 19 02:33:31.055099 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 480/950] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:30 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1578 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:31.336242 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-90372d4e-0eba-4bf7-81b4-c40a9dd85bcc req-9079a62e-f65e-4156-8643-29b65ef73c0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "900317e8-8e9d-49e0-927b-a4d30c204f2c", "name": "network-vif-plugged", "status": "completed", "tag": "9b55214e-d4a5-4d7f-a090-48b12fdd6991"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:33:31.338444 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:33:31.338444 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:33:31.348572 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-90372d4e-0eba-4bf7-81b4-c40a9dd85bcc req-9079a62e-f65e-4156-8643-29b65ef73c0f service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:31.349257 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-90372d4e-0eba-4bf7-81b4-c40a9dd85bcc req-9079a62e-f65e-4156-8643-29b65ef73c0f service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:31.370538 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-90372d4e-0eba-4bf7-81b4-c40a9dd85bcc req-9079a62e-f65e-4156-8643-29b65ef73c0f service nova] Creating event network-vif-plugged:9b55214e-d4a5-4d7f-a090-48b12fdd6991 for instance 900317e8-8e9d-49e0-927b-a4d30c204f2c on hv-cinder-77642 Feb 19 02:33:31.375576 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-90372d4e-0eba-4bf7-81b4-c40a9dd85bcc req-9079a62e-f65e-4156-8643-29b65ef73c0f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043642 Feb 19 02:33:31.376403 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 471/951] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:33:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:33:32.073041 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-fc8efbc7-acc1-4f49-8f70-2bbc8550883e tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:32.073717 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-fc8efbc7-acc1-4f49-8f70-2bbc8550883e tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:32.082780 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fc8efbc7-acc1-4f49-8f70-2bbc8550883e tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:32.083298 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fc8efbc7-acc1-4f49-8f70-2bbc8550883e tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:32.084142 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fc8efbc7-acc1-4f49-8f70-2bbc8550883e tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:32.084635 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fc8efbc7-acc1-4f49-8f70-2bbc8550883e tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:32.300622 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-fc8efbc7-acc1-4f49-8f70-2bbc8550883e tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:32.310051 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-fc8efbc7-acc1-4f49-8f70-2bbc8550883e tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1578 microversion: 2.1 time: 0.241184 Feb 19 02:33:32.310717 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 481/952] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:32 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1578 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:33.330236 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-eb83d6dc-c16d-4cde-a45c-c1cbc4a635fa tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:33.331385 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-eb83d6dc-c16d-4cde-a45c-c1cbc4a635fa tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:33.340160 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-eb83d6dc-c16d-4cde-a45c-c1cbc4a635fa tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:33.340660 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-eb83d6dc-c16d-4cde-a45c-c1cbc4a635fa tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:33.341525 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-eb83d6dc-c16d-4cde-a45c-c1cbc4a635fa tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:33.342168 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-eb83d6dc-c16d-4cde-a45c-c1cbc4a635fa tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:33.782857 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-eb83d6dc-c16d-4cde-a45c-c1cbc4a635fa tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:33.794540 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-eb83d6dc-c16d-4cde-a45c-c1cbc4a635fa tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1565 microversion: 2.1 time: 0.469139 Feb 19 02:33:33.795168 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 472/953] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:33 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1565 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:35.793227 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f00f2d89-2b68-4a9e-9ed2-2b3b978c8cb5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:35.793811 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f00f2d89-2b68-4a9e-9ed2-2b3b978c8cb5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:35.801666 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f00f2d89-2b68-4a9e-9ed2-2b3b978c8cb5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:35.802168 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f00f2d89-2b68-4a9e-9ed2-2b3b978c8cb5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:35.803139 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f00f2d89-2b68-4a9e-9ed2-2b3b978c8cb5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:35.803629 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f00f2d89-2b68-4a9e-9ed2-2b3b978c8cb5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:35.869680 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f00f2d89-2b68-4a9e-9ed2-2b3b978c8cb5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Going to try to terminate instance {{(pid=98193) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 02:33:35.992833 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f00f2d89-2b68-4a9e-9ed2-2b3b978c8cb5 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "DELETE /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 204 len: 0 microversion: 2.20 time: 0.203723 Feb 19 02:33:35.993865 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 482/954] 10.222.0.44 () {60 vars in 1270 bytes} [Fri Feb 19 02:33:35 2021] DELETE /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 19 02:33:36.002901 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-9b2ce8d9-7b74-4156-b3a6-ba0f47c006c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:36.003582 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-9b2ce8d9-7b74-4156-b3a6-ba0f47c006c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:36.011528 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9b2ce8d9-7b74-4156-b3a6-ba0f47c006c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:36.012037 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9b2ce8d9-7b74-4156-b3a6-ba0f47c006c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:36.012876 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9b2ce8d9-7b74-4156-b3a6-ba0f47c006c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:36.013372 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9b2ce8d9-7b74-4156-b3a6-ba0f47c006c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:36.232435 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9b2ce8d9-7b74-4156-b3a6-ba0f47c006c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:36.241812 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9b2ce8d9-7b74-4156-b3a6-ba0f47c006c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:36.243427 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9b2ce8d9-7b74-4156-b3a6-ba0f47c006c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:36.244653 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-9b2ce8d9-7b74-4156-b3a6-ba0f47c006c4 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1722 microversion: 2.20 time: 0.246333 Feb 19 02:33:36.245257 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 473/955] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:33:35 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:33:37.284711 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-9945f8b8-059a-4df2-a3a9-8656c26a4075 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:37.285492 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-9945f8b8-059a-4df2-a3a9-8656c26a4075 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:37.306271 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9945f8b8-059a-4df2-a3a9-8656c26a4075 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:37.306842 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9945f8b8-059a-4df2-a3a9-8656c26a4075 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:37.307710 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9945f8b8-059a-4df2-a3a9-8656c26a4075 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:37.308204 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9945f8b8-059a-4df2-a3a9-8656c26a4075 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:37.908065 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9945f8b8-059a-4df2-a3a9-8656c26a4075 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:37.918584 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9945f8b8-059a-4df2-a3a9-8656c26a4075 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:37.920339 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9945f8b8-059a-4df2-a3a9-8656c26a4075 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:37.921366 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-9945f8b8-059a-4df2-a3a9-8656c26a4075 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1722 microversion: 2.20 time: 0.658212 Feb 19 02:33:37.922084 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 483/956] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:33:37 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1722 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:33:38.628368 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-05d02f08-d6e1-4f2d-9b39-185473046c66 req-e38c5281-e479-4569-8446-a0c3bf7f8ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb5c58f3-abb6-4bda-8928-db72606dcefd", "name": "network-vif-unplugged", "status": "completed", "tag": "c6e75aba-17c0-47ae-b251-61c34117a52a"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:33:38.631408 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:33:38.631408 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:33:38.650052 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-05d02f08-d6e1-4f2d-9b39-185473046c66 req-e38c5281-e479-4569-8446-a0c3bf7f8ae1 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:38.650790 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-05d02f08-d6e1-4f2d-9b39-185473046c66 req-e38c5281-e479-4569-8446-a0c3bf7f8ae1 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:38.671126 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-05d02f08-d6e1-4f2d-9b39-185473046c66 req-e38c5281-e479-4569-8446-a0c3bf7f8ae1 service nova] Creating event network-vif-unplugged:c6e75aba-17c0-47ae-b251-61c34117a52a for instance eb5c58f3-abb6-4bda-8928-db72606dcefd on hv-cinder-77642 Feb 19 02:33:38.677364 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-05d02f08-d6e1-4f2d-9b39-185473046c66 req-e38c5281-e479-4569-8446-a0c3bf7f8ae1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055198 Feb 19 02:33:38.678513 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 474/957] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:33:38 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:33:38.941488 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-02217025-bc89-4d99-85b7-5c3bfe90fc57 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:38.942153 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-02217025-bc89-4d99-85b7-5c3bfe90fc57 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:38.950095 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-02217025-bc89-4d99-85b7-5c3bfe90fc57 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:38.950631 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-02217025-bc89-4d99-85b7-5c3bfe90fc57 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:38.951465 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-02217025-bc89-4d99-85b7-5c3bfe90fc57 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:38.951952 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-02217025-bc89-4d99-85b7-5c3bfe90fc57 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:39.221907 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-02217025-bc89-4d99-85b7-5c3bfe90fc57 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:39.235065 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-02217025-bc89-4d99-85b7-5c3bfe90fc57 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:39.237546 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-02217025-bc89-4d99-85b7-5c3bfe90fc57 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:39.238993 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-02217025-bc89-4d99-85b7-5c3bfe90fc57 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1722 microversion: 2.20 time: 0.301661 Feb 19 02:33:39.240052 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 484/958] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:33:38 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1722 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:33:40.260458 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c0373091-8ce3-4a15-ae29-e36e226eec5b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:40.261200 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c0373091-8ce3-4a15-ae29-e36e226eec5b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:40.269670 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c0373091-8ce3-4a15-ae29-e36e226eec5b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:40.270518 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c0373091-8ce3-4a15-ae29-e36e226eec5b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:40.271375 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c0373091-8ce3-4a15-ae29-e36e226eec5b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:40.271848 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c0373091-8ce3-4a15-ae29-e36e226eec5b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:40.401115 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c0373091-8ce3-4a15-ae29-e36e226eec5b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:40.410944 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c0373091-8ce3-4a15-ae29-e36e226eec5b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:40.412699 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c0373091-8ce3-4a15-ae29-e36e226eec5b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:40.413902 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c0373091-8ce3-4a15-ae29-e36e226eec5b tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1654 microversion: 2.20 time: 0.158203 Feb 19 02:33:40.414545 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 475/959] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:33:40 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1654 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:33:41.134130 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-5d4cc7ec-decd-4adf-8fe8-5d2976ce7d06 req-207f1c04-f712-480b-ba9e-5af2746fdf49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb5c58f3-abb6-4bda-8928-db72606dcefd", "name": "network-vif-deleted", "tag": "c6e75aba-17c0-47ae-b251-61c34117a52a"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:33:41.135893 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:33:41.135893 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:33:41.145431 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-5d4cc7ec-decd-4adf-8fe8-5d2976ce7d06 req-207f1c04-f712-480b-ba9e-5af2746fdf49 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:41.147704 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-5d4cc7ec-decd-4adf-8fe8-5d2976ce7d06 req-207f1c04-f712-480b-ba9e-5af2746fdf49 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:41.165283 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-5d4cc7ec-decd-4adf-8fe8-5d2976ce7d06 req-207f1c04-f712-480b-ba9e-5af2746fdf49 service nova] Creating event network-vif-deleted:c6e75aba-17c0-47ae-b251-61c34117a52a for instance eb5c58f3-abb6-4bda-8928-db72606dcefd on hv-cinder-77642 Feb 19 02:33:41.170517 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-5d4cc7ec-decd-4adf-8fe8-5d2976ce7d06 req-207f1c04-f712-480b-ba9e-5af2746fdf49 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040829 Feb 19 02:33:41.171371 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 485/960] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:33:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:33:41.434820 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e9bcc351-8581-4b14-a02d-8035d42f0adf tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:41.435462 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e9bcc351-8581-4b14-a02d-8035d42f0adf tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:41.444183 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e9bcc351-8581-4b14-a02d-8035d42f0adf tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:41.444682 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e9bcc351-8581-4b14-a02d-8035d42f0adf tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:41.445514 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e9bcc351-8581-4b14-a02d-8035d42f0adf tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:41.445999 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e9bcc351-8581-4b14-a02d-8035d42f0adf tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:41.521717 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e9bcc351-8581-4b14-a02d-8035d42f0adf tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:41.522375 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e9bcc351-8581-4b14-a02d-8035d42f0adf tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:41.522888 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.objects.instance [None req-e9bcc351-8581-4b14-a02d-8035d42f0adf tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lazy-loading 'fault' on Instance uuid eb5c58f3-abb6-4bda-8928-db72606dcefd {{(pid=98194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 02:33:41.619845 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e9bcc351-8581-4b14-a02d-8035d42f0adf tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:41.630519 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e9bcc351-8581-4b14-a02d-8035d42f0adf tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:41.632325 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e9bcc351-8581-4b14-a02d-8035d42f0adf tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '485c785ecc8b41ffa4a9b1e908cb5145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e1c746a8dc450eb96f1b22cd181e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:41.633988 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e9bcc351-8581-4b14-a02d-8035d42f0adf tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 200 len: 1370 microversion: 2.20 time: 0.203165 Feb 19 02:33:41.634812 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 476/961] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:33:41 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 1370 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 19 02:33:42.654561 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8214c4f3-ddba-47b8-920f-e39078a288ef tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:42.655351 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8214c4f3-ddba-47b8-920f-e39078a288ef tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:42.663791 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8214c4f3-ddba-47b8-920f-e39078a288ef tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:42.664278 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8214c4f3-ddba-47b8-920f-e39078a288ef tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:42.665129 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8214c4f3-ddba-47b8-920f-e39078a288ef tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:42.665620 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8214c4f3-ddba-47b8-920f-e39078a288ef tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:42.723434 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-8214c4f3-ddba-47b8-920f-e39078a288ef tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] HTTP exception thrown: Instance eb5c58f3-abb6-4bda-8928-db72606dcefd could not be found. Feb 19 02:33:42.724104 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8214c4f3-ddba-47b8-920f-e39078a288ef tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Returning 404 to user: Instance eb5c58f3-abb6-4bda-8928-db72606dcefd could not be found. {{(pid=98193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:33:42.725014 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8214c4f3-ddba-47b8-920f-e39078a288ef tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 404 len: 111 microversion: 2.20 time: 0.075472 Feb 19 02:33:42.725641 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 486/962] 10.222.0.44 () {60 vars in 1267 bytes} [Fri Feb 19 02:33:42 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 19 02:33:42.734765 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ac49a564-e611-4b7b-a2d1-38f782de2227 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '.version_select at 0x7f217e1df2f0>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:42.753464 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ac49a564-e611-4b7b-a2d1-38f782de2227 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-306291204" status: 204 len: 0 microversion: 2.20 time: 0.022807 Feb 19 02:33:42.754128 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 477/963] 10.222.0.44 () {60 vars in 1249 bytes} [Fri Feb 19 02:33:42 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-306291204 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 19 02:33:44.714256 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-55922614-e8c6-42ce-8776-f80f3d23dc8f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:33:44.715224 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-55922614-e8c6-42ce-8776-f80f3d23dc8f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:44.725251 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-55922614-e8c6-42ce-8776-f80f3d23dc8f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:44.725977 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-55922614-e8c6-42ce-8776-f80f3d23dc8f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:44.727049 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-55922614-e8c6-42ce-8776-f80f3d23dc8f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:44.727679 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-55922614-e8c6-42ce-8776-f80f3d23dc8f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:44.879067 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-55922614-e8c6-42ce-8776-f80f3d23dc8f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "POST /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/action" status: 202 len: 0 microversion: 2.1 time: 0.168640 Feb 19 02:33:44.882942 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 487/964] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:33:44 2021] POST /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:33:44.889201 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-689f69ca-4219-4e64-9ab8-b0a95ad9200f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:44.890076 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-689f69ca-4219-4e64-9ab8-b0a95ad9200f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:44.900822 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-689f69ca-4219-4e64-9ab8-b0a95ad9200f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:44.901606 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-689f69ca-4219-4e64-9ab8-b0a95ad9200f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:44.902598 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-689f69ca-4219-4e64-9ab8-b0a95ad9200f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:44.903178 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-689f69ca-4219-4e64-9ab8-b0a95ad9200f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:45.211171 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-689f69ca-4219-4e64-9ab8-b0a95ad9200f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:45.217019 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1d57607a-03d0-430c-b4b1-ea0054537b20 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:45.217834 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1d57607a-03d0-430c-b4b1-ea0054537b20 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:45.218663 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-689f69ca-4219-4e64-9ab8-b0a95ad9200f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1760 microversion: 2.1 time: 0.334269 Feb 19 02:33:45.219381 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 478/965] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:44 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1760 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:45.226576 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1d57607a-03d0-430c-b4b1-ea0054537b20 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:45.227275 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1d57607a-03d0-430c-b4b1-ea0054537b20 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:45.228272 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1d57607a-03d0-430c-b4b1-ea0054537b20 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:45.228929 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1d57607a-03d0-430c-b4b1-ea0054537b20 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:45.282759 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-1d57607a-03d0-430c-b4b1-ea0054537b20 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] HTTP exception thrown: Instance eb5c58f3-abb6-4bda-8928-db72606dcefd could not be found. Feb 19 02:33:45.283690 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1d57607a-03d0-430c-b4b1-ea0054537b20 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Returning 404 to user: Instance eb5c58f3-abb6-4bda-8928-db72606dcefd could not be found. {{(pid=98193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:33:45.284598 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1d57607a-03d0-430c-b4b1-ea0054537b20 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "DELETE /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 404 len: 111 microversion: 2.1 time: 0.072058 Feb 19 02:33:45.285211 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 488/966] 10.222.0.44 () {58 vars in 1229 bytes} [Fri Feb 19 02:33:45 2021] DELETE /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 02:33:45.293955 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4f818211-0524-4df0-afa8-4c91b01b1cda tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:45.294743 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-4f818211-0524-4df0-afa8-4c91b01b1cda tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: eb5c58f3-abb6-4bda-8928-db72606dcefd] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:45.302798 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4f818211-0524-4df0-afa8-4c91b01b1cda tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:45.303385 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4f818211-0524-4df0-afa8-4c91b01b1cda tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:45.304303 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4f818211-0524-4df0-afa8-4c91b01b1cda tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:45.304859 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4f818211-0524-4df0-afa8-4c91b01b1cda tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:45.362137 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-4f818211-0524-4df0-afa8-4c91b01b1cda tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] HTTP exception thrown: Instance eb5c58f3-abb6-4bda-8928-db72606dcefd could not be found. Feb 19 02:33:45.362970 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4f818211-0524-4df0-afa8-4c91b01b1cda tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Returning 404 to user: Instance eb5c58f3-abb6-4bda-8928-db72606dcefd could not be found. {{(pid=98194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:33:45.363871 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-4f818211-0524-4df0-afa8-4c91b01b1cda tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd" status: 404 len: 111 microversion: 2.1 time: 0.074188 Feb 19 02:33:45.366092 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 479/967] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:45 2021] GET /compute/v2.1/servers/eb5c58f3-abb6-4bda-8928-db72606dcefd => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 02:33:46.237250 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c9e65e28-1294-407a-8af2-23948fb25d3d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:46.237915 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c9e65e28-1294-407a-8af2-23948fb25d3d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:46.245660 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c9e65e28-1294-407a-8af2-23948fb25d3d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:46.246159 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c9e65e28-1294-407a-8af2-23948fb25d3d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:46.247036 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c9e65e28-1294-407a-8af2-23948fb25d3d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:46.247521 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c9e65e28-1294-407a-8af2-23948fb25d3d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:46.467667 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c9e65e28-1294-407a-8af2-23948fb25d3d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:46.479091 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c9e65e28-1294-407a-8af2-23948fb25d3d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1765 microversion: 2.1 time: 0.245804 Feb 19 02:33:46.479812 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 489/968] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:46 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1765 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:46.614497 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4f9c8a41-b8f8-40ee-ae2f-79fe530cd073 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:46.615045 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-4f9c8a41-b8f8-40ee-ae2f-79fe530cd073 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:46.622940 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4f9c8a41-b8f8-40ee-ae2f-79fe530cd073 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:46.623444 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4f9c8a41-b8f8-40ee-ae2f-79fe530cd073 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:46.624277 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4f9c8a41-b8f8-40ee-ae2f-79fe530cd073 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:46.624789 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4f9c8a41-b8f8-40ee-ae2f-79fe530cd073 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:46.678564 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-4f9c8a41-b8f8-40ee-ae2f-79fe530cd073 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] HTTP exception thrown: Instance 5265f377-f5b9-4f2c-a6e8-3bf64fb08733 could not be found. Feb 19 02:33:46.679224 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4f9c8a41-b8f8-40ee-ae2f-79fe530cd073 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Returning 404 to user: Instance 5265f377-f5b9-4f2c-a6e8-3bf64fb08733 could not be found. {{(pid=98194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:33:46.680119 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-4f9c8a41-b8f8-40ee-ae2f-79fe530cd073 tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 404 len: 111 microversion: 2.1 time: 0.069718 Feb 19 02:33:46.680716 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 480/969] 10.222.0.44 () {58 vars in 1229 bytes} [Fri Feb 19 02:33:46 2021] DELETE /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 02:33:46.689040 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f2deda67-e127-4c21-b030-135eb0ae0e6a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:46.690230 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f2deda67-e127-4c21-b030-135eb0ae0e6a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] [instance: 5265f377-f5b9-4f2c-a6e8-3bf64fb08733] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:46.698154 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f2deda67-e127-4c21-b030-135eb0ae0e6a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:46.698698 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f2deda67-e127-4c21-b030-135eb0ae0e6a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:46.699525 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f2deda67-e127-4c21-b030-135eb0ae0e6a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:46.700013 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f2deda67-e127-4c21-b030-135eb0ae0e6a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:46.754893 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-f2deda67-e127-4c21-b030-135eb0ae0e6a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] HTTP exception thrown: Instance 5265f377-f5b9-4f2c-a6e8-3bf64fb08733 could not be found. Feb 19 02:33:46.755479 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f2deda67-e127-4c21-b030-135eb0ae0e6a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] Returning 404 to user: Instance 5265f377-f5b9-4f2c-a6e8-3bf64fb08733 could not be found. {{(pid=98193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:33:46.756508 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f2deda67-e127-4c21-b030-135eb0ae0e6a tempest-AttachVolumeShelveTestJSON-2054470095 tempest-AttachVolumeShelveTestJSON-2054470095-project] 10.222.0.44 "GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733" status: 404 len: 111 microversion: 2.1 time: 0.071466 Feb 19 02:33:46.757126 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 490/970] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:46 2021] GET /compute/v2.1/servers/5265f377-f5b9-4f2c-a6e8-3bf64fb08733 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 02:33:47.497800 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-0b5ab174-a4b2-49fb-a054-50acf37f4c8e tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:47.498631 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-0b5ab174-a4b2-49fb-a054-50acf37f4c8e tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:47.506804 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0b5ab174-a4b2-49fb-a054-50acf37f4c8e tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:47.507608 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0b5ab174-a4b2-49fb-a054-50acf37f4c8e tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:47.508650 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0b5ab174-a4b2-49fb-a054-50acf37f4c8e tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:47.509150 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0b5ab174-a4b2-49fb-a054-50acf37f4c8e tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:47.950305 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-0b5ab174-a4b2-49fb-a054-50acf37f4c8e tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:47.961936 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-0b5ab174-a4b2-49fb-a054-50acf37f4c8e tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1765 microversion: 2.1 time: 0.468369 Feb 19 02:33:47.962369 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 481/971] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:47 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1765 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:48.981338 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d8f26316-0a1f-4d4b-ba6c-e8bcbe2bf423 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:48.982118 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d8f26316-0a1f-4d4b-ba6c-e8bcbe2bf423 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:48.991858 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d8f26316-0a1f-4d4b-ba6c-e8bcbe2bf423 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:48.992504 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d8f26316-0a1f-4d4b-ba6c-e8bcbe2bf423 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:48.993574 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d8f26316-0a1f-4d4b-ba6c-e8bcbe2bf423 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:48.994207 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d8f26316-0a1f-4d4b-ba6c-e8bcbe2bf423 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:49.469466 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-d8f26316-0a1f-4d4b-ba6c-e8bcbe2bf423 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:49.479734 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d8f26316-0a1f-4d4b-ba6c-e8bcbe2bf423 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1765 microversion: 2.1 time: 0.502850 Feb 19 02:33:49.480355 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 491/972] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:48 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1765 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:50.498702 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e0e63a03-485c-443f-ada7-6443029ebb1d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:50.500029 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e0e63a03-485c-443f-ada7-6443029ebb1d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:50.508723 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e0e63a03-485c-443f-ada7-6443029ebb1d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:50.509654 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e0e63a03-485c-443f-ada7-6443029ebb1d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:50.511131 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e0e63a03-485c-443f-ada7-6443029ebb1d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:50.511839 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e0e63a03-485c-443f-ada7-6443029ebb1d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:50.967394 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e0e63a03-485c-443f-ada7-6443029ebb1d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:50.992411 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e0e63a03-485c-443f-ada7-6443029ebb1d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1765 microversion: 2.1 time: 0.497403 Feb 19 02:33:50.993478 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 482/973] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:50 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1765 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:52.012451 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8f8bd966-5586-4db2-957a-a752bd2a1026 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:52.013053 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8f8bd966-5586-4db2-957a-a752bd2a1026 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:52.022884 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8f8bd966-5586-4db2-957a-a752bd2a1026 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:52.023549 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8f8bd966-5586-4db2-957a-a752bd2a1026 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:52.024420 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8f8bd966-5586-4db2-957a-a752bd2a1026 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:52.024915 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8f8bd966-5586-4db2-957a-a752bd2a1026 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:52.246868 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8f8bd966-5586-4db2-957a-a752bd2a1026 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:52.256420 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8f8bd966-5586-4db2-957a-a752bd2a1026 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1765 microversion: 2.1 time: 0.248744 Feb 19 02:33:52.257033 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 492/974] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:52 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1765 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:53.275411 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d6a887e8-d55a-4dca-a0a1-c64bb395acf6 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:53.276079 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d6a887e8-d55a-4dca-a0a1-c64bb395acf6 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:53.283917 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d6a887e8-d55a-4dca-a0a1-c64bb395acf6 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:53.284427 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d6a887e8-d55a-4dca-a0a1-c64bb395acf6 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:53.285259 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d6a887e8-d55a-4dca-a0a1-c64bb395acf6 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:53.285746 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d6a887e8-d55a-4dca-a0a1-c64bb395acf6 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:53.520031 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-d6a887e8-d55a-4dca-a0a1-c64bb395acf6 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:53.530995 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d6a887e8-d55a-4dca-a0a1-c64bb395acf6 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1765 microversion: 2.1 time: 0.260033 Feb 19 02:33:53.531840 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 483/975] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:53 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1765 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:54.550165 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c1fa1a07-da50-4c8a-bf59-362ab365bd50 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:54.550855 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c1fa1a07-da50-4c8a-bf59-362ab365bd50 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:54.558861 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c1fa1a07-da50-4c8a-bf59-362ab365bd50 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:54.559362 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c1fa1a07-da50-4c8a-bf59-362ab365bd50 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:54.560190 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c1fa1a07-da50-4c8a-bf59-362ab365bd50 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:54.560673 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c1fa1a07-da50-4c8a-bf59-362ab365bd50 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:54.803238 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c1fa1a07-da50-4c8a-bf59-362ab365bd50 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:54.818660 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c1fa1a07-da50-4c8a-bf59-362ab365bd50 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1765 microversion: 2.1 time: 0.272940 Feb 19 02:33:54.819276 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 493/976] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:54 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1765 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:55.837578 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8fa117dd-5985-4149-8182-1cd3bc733197 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:55.838491 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8fa117dd-5985-4149-8182-1cd3bc733197 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:55.846667 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8fa117dd-5985-4149-8182-1cd3bc733197 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:55.847167 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8fa117dd-5985-4149-8182-1cd3bc733197 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:55.847991 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8fa117dd-5985-4149-8182-1cd3bc733197 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:55.848474 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8fa117dd-5985-4149-8182-1cd3bc733197 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:56.060346 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8fa117dd-5985-4149-8182-1cd3bc733197 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:56.069686 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8fa117dd-5985-4149-8182-1cd3bc733197 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1765 microversion: 2.1 time: 0.236183 Feb 19 02:33:56.070305 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 484/977] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:55 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1765 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:56.887046 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-bd6359b9-74e3-4dae-806b-1af2aa72b0dd tempest-VolumesTestJSON-1208195184 tempest-VolumesTestJSON-1208195184-project] Calling method '.version_select at 0x7f217c59d378>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:56.987452 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-bd6359b9-74e3-4dae-806b-1af2aa72b0dd tempest-VolumesTestJSON-1208195184 tempest-VolumesTestJSON-1208195184-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/ada53298-8bc3-4287-82be-f86c221f0f9d" status: 200 len: 351 microversion: 2.1 time: 0.104291 Feb 19 02:33:56.988083 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 494/978] 10.222.0.44 () {58 vars in 1235 bytes} [Fri Feb 19 02:33:56 2021] GET /compute/v2.1/os-volumes/ada53298-8bc3-4287-82be-f86c221f0f9d => generated 351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:33:57.088836 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-921c2e44-2cb8-45aa-8612-8ac1f6e7e58e tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:57.089503 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-921c2e44-2cb8-45aa-8612-8ac1f6e7e58e tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:57.097783 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-921c2e44-2cb8-45aa-8612-8ac1f6e7e58e tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:57.098294 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-921c2e44-2cb8-45aa-8612-8ac1f6e7e58e tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:57.099156 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-921c2e44-2cb8-45aa-8612-8ac1f6e7e58e tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:57.099649 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-921c2e44-2cb8-45aa-8612-8ac1f6e7e58e tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:57.320615 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-921c2e44-2cb8-45aa-8612-8ac1f6e7e58e tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:57.330979 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-921c2e44-2cb8-45aa-8612-8ac1f6e7e58e tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1765 microversion: 2.1 time: 0.246119 Feb 19 02:33:57.342201 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 485/979] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:57 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1765 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:58.349395 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4a0f6b90-e16a-428e-b9f9-049a2158a201 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:58.350087 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-4a0f6b90-e16a-428e-b9f9-049a2158a201 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:58.357927 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4a0f6b90-e16a-428e-b9f9-049a2158a201 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:58.358484 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4a0f6b90-e16a-428e-b9f9-049a2158a201 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:58.359326 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4a0f6b90-e16a-428e-b9f9-049a2158a201 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:58.359819 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4a0f6b90-e16a-428e-b9f9-049a2158a201 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:58.572636 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e9eebf3a-915f-4ebd-86b0-f70249a2ab34 tempest-VolumesTestJSON-1208195184 tempest-VolumesTestJSON-1208195184-project] Calling method '.version_select at 0x7f217d62c378>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:58.606240 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-4a0f6b90-e16a-428e-b9f9-049a2158a201 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:58.617356 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-4a0f6b90-e16a-428e-b9f9-049a2158a201 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1765 microversion: 2.1 time: 0.271976 Feb 19 02:33:58.618464 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 495/980] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:58 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1765 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:33:58.680665 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e9eebf3a-915f-4ebd-86b0-f70249a2ab34 tempest-VolumesTestJSON-1208195184 tempest-VolumesTestJSON-1208195184-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/e206d7e9-7e58-4a72-82f5-f468f1000110" status: 200 len: 351 microversion: 2.1 time: 0.112885 Feb 19 02:33:58.681522 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 486/981] 10.222.0.44 () {58 vars in 1235 bytes} [Fri Feb 19 02:33:58 2021] GET /compute/v2.1/os-volumes/e206d7e9-7e58-4a72-82f5-f468f1000110 => generated 351 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:33:59.636128 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-fcceea1e-0825-43b0-b74a-3216ee7674ef tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:33:59.636958 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-fcceea1e-0825-43b0-b74a-3216ee7674ef tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:33:59.644768 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fcceea1e-0825-43b0-b74a-3216ee7674ef tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:59.645271 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fcceea1e-0825-43b0-b74a-3216ee7674ef tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:59.646099 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fcceea1e-0825-43b0-b74a-3216ee7674ef tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:33:59.646614 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fcceea1e-0825-43b0-b74a-3216ee7674ef tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:33:59.868383 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-fcceea1e-0825-43b0-b74a-3216ee7674ef tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:33:59.878566 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-fcceea1e-0825-43b0-b74a-3216ee7674ef tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1765 microversion: 2.1 time: 0.246456 Feb 19 02:33:59.879307 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 496/982] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:33:59 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1765 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:34:00.256329 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-6de16081-f88d-4ac6-8395-fc7f7837b035 tempest-VolumesTestJSON-1208195184 tempest-VolumesTestJSON-1208195184-project] Calling method '.version_select at 0x7f217d62cae8>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:00.354202 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-6de16081-f88d-4ac6-8395-fc7f7837b035 tempest-VolumesTestJSON-1208195184 tempest-VolumesTestJSON-1208195184-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/7607feb2-159c-4544-a16e-53eb20e1a77b" status: 200 len: 349 microversion: 2.1 time: 0.101766 Feb 19 02:34:00.355344 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 487/983] 10.222.0.44 () {58 vars in 1235 bytes} [Fri Feb 19 02:34:00 2021] GET /compute/v2.1/os-volumes/7607feb2-159c-4544-a16e-53eb20e1a77b => generated 349 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:34:00.367972 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-23f17f27-7ad0-4711-ba2c-2d0a391c9eaf tempest-VolumesTestJSON-1208195184 tempest-VolumesTestJSON-1208195184-project] Calling method '.version_select at 0x7f217cde97b8>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:00.457179 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-23f17f27-7ad0-4711-ba2c-2d0a391c9eaf tempest-VolumesTestJSON-1208195184 tempest-VolumesTestJSON-1208195184-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.093312 Feb 19 02:34:00.457893 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 497/984] 10.222.0.44 () {58 vars in 1124 bytes} [Fri Feb 19 02:34:00 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:34:00.471946 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-09ce422d-34f5-4621-9c70-50caaddbdd7a tempest-VolumesTestJSON-1208195184 tempest-VolumesTestJSON-1208195184-project] Calling method '.version_select at 0x7f217d5ff620>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:00.561180 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-09ce422d-34f5-4621-9c70-50caaddbdd7a tempest-VolumesTestJSON-1208195184 tempest-VolumesTestJSON-1208195184-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.093738 Feb 19 02:34:00.561816 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 488/985] 10.222.0.44 () {58 vars in 1139 bytes} [Fri Feb 19 02:34:00 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:34:00.574285 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8fb5d2f8-fcb8-481b-852a-39cb7bf868a7 tempest-VolumesTestJSON-1208195184 tempest-VolumesTestJSON-1208195184-project] Calling method '.version_select at 0x7f217c59dd90>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:00.661435 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8fb5d2f8-fcb8-481b-852a-39cb7bf868a7 tempest-VolumesTestJSON-1208195184 tempest-VolumesTestJSON-1208195184-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.090962 Feb 19 02:34:00.662064 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 498/986] 10.222.0.44 () {58 vars in 1124 bytes} [Fri Feb 19 02:34:00 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:34:00.673920 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-28feed27-8551-4f34-a283-0959bd2c2715 tempest-VolumesTestJSON-1208195184 tempest-VolumesTestJSON-1208195184-project] Calling method '.version_select at 0x7f217c1a8bf8>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:00.760869 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-28feed27-8551-4f34-a283-0959bd2c2715 tempest-VolumesTestJSON-1208195184 tempest-VolumesTestJSON-1208195184-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.090840 Feb 19 02:34:00.761568 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 489/987] 10.222.0.44 () {58 vars in 1157 bytes} [Fri Feb 19 02:34:00 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:34:00.774650 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f05da830-879b-4a95-b621-0f167fc8ad78 tempest-VolumesTestJSON-1208195184 tempest-VolumesTestJSON-1208195184-project] Calling method '.version_select at 0x7f217c4e9840>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:00.862571 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f05da830-879b-4a95-b621-0f167fc8ad78 tempest-VolumesTestJSON-1208195184 tempest-VolumesTestJSON-1208195184-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.091715 Feb 19 02:34:00.863306 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 499/988] 10.222.0.44 () {58 vars in 1160 bytes} [Fri Feb 19 02:34:00 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:34:00.876475 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ff3ad538-d2a4-4209-a360-41a3be440fc1 tempest-VolumesTestJSON-1208195184 tempest-VolumesTestJSON-1208195184-project] Calling method '.version_select at 0x7f217c54e510>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:00.897067 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-042d62aa-b576-4959-8e47-3874b45db0d7 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:00.897789 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-042d62aa-b576-4959-8e47-3874b45db0d7 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:34:00.905889 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-042d62aa-b576-4959-8e47-3874b45db0d7 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:00.906457 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-042d62aa-b576-4959-8e47-3874b45db0d7 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:00.907313 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-042d62aa-b576-4959-8e47-3874b45db0d7 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:00.907809 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-042d62aa-b576-4959-8e47-3874b45db0d7 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:00.963662 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ff3ad538-d2a4-4209-a360-41a3be440fc1 tempest-VolumesTestJSON-1208195184 tempest-VolumesTestJSON-1208195184-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.091113 Feb 19 02:34:00.964612 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 490/989] 10.222.0.44 () {58 vars in 1145 bytes} [Fri Feb 19 02:34:00 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:34:00.977665 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c0ebf732-c091-408f-a9af-93a53a4c4850 tempest-VolumesTestJSON-1208195184 tempest-VolumesTestJSON-1208195184-project] Calling method '.version_select at 0x7f217d62cf28>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:01.071289 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c0ebf732-c091-408f-a9af-93a53a4c4850 tempest-VolumesTestJSON-1208195184 tempest-VolumesTestJSON-1208195184-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.097709 Feb 19 02:34:01.071908 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 491/990] 10.222.0.44 () {58 vars in 1178 bytes} [Fri Feb 19 02:34:00 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:34:01.084908 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-276f7b34-ad34-497d-95a8-92e34a094628 tempest-VolumesTestJSON-1208195184 tempest-VolumesTestJSON-1208195184-project] Calling method '.version_select at 0x7f217d5ff7b8>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:01.148670 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-042d62aa-b576-4959-8e47-3874b45db0d7 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:34:01.159861 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-042d62aa-b576-4959-8e47-3874b45db0d7 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1765 microversion: 2.1 time: 0.266635 Feb 19 02:34:01.160687 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 500/991] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:34:00 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1765 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:34:01.172103 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-276f7b34-ad34-497d-95a8-92e34a094628 tempest-VolumesTestJSON-1208195184 tempest-VolumesTestJSON-1208195184-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.090788 Feb 19 02:34:01.172741 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 492/992] 10.222.0.44 () {58 vars in 1145 bytes} [Fri Feb 19 02:34:01 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:34:02.178711 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-9d7176d7-f6bd-4e61-a8e0-5460d6151204 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:02.179495 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-9d7176d7-f6bd-4e61-a8e0-5460d6151204 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:34:02.187334 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9d7176d7-f6bd-4e61-a8e0-5460d6151204 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:02.187847 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9d7176d7-f6bd-4e61-a8e0-5460d6151204 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:02.188692 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9d7176d7-f6bd-4e61-a8e0-5460d6151204 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:02.189265 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9d7176d7-f6bd-4e61-a8e0-5460d6151204 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:02.410033 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9d7176d7-f6bd-4e61-a8e0-5460d6151204 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:34:02.419822 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-9d7176d7-f6bd-4e61-a8e0-5460d6151204 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1768 microversion: 2.1 time: 0.245106 Feb 19 02:34:02.420666 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 501/993] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:34:02 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1768 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:34:06.480540 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b6f3bae0-29ac-4fbc-8860-b995cf6ce028 tempest-VolumesNegativeTest-956911451 tempest-VolumesNegativeTest-956911451-project] Action: 'create', calling method: .version_select at 0x7f217c0ef730>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-41556253", "metadata": {"Type": "work"}}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:34:06.482067 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b6f3bae0-29ac-4fbc-8860-b995cf6ce028 tempest-VolumesNegativeTest-956911451 tempest-VolumesNegativeTest-956911451-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=98194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:34:06.483018 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b6f3bae0-29ac-4fbc-8860-b995cf6ce028 tempest-VolumesNegativeTest-956911451 tempest-VolumesNegativeTest-956911451-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.128425 Feb 19 02:34:06.483607 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 493/994] 10.222.0.44 () {60 vars in 1146 bytes} [Fri Feb 19 02:34:06 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 02:34:06.493784 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8769caa4-72f4-4b51-972a-a955c8832784 tempest-VolumesNegativeTest-956911451 tempest-VolumesNegativeTest-956911451-project] Action: 'create', calling method: .version_select at 0x7f217d61e0d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1738980691", "metadata": {"Type": "work"}}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:34:06.495363 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8769caa4-72f4-4b51-972a-a955c8832784 tempest-VolumesNegativeTest-956911451 tempest-VolumesNegativeTest-956911451-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=98193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:34:06.496211 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8769caa4-72f4-4b51-972a-a955c8832784 tempest-VolumesNegativeTest-956911451 tempest-VolumesNegativeTest-956911451-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006534 Feb 19 02:34:06.500617 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 502/995] 10.222.0.44 () {60 vars in 1146 bytes} [Fri Feb 19 02:34:06 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 19 02:34:06.506318 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-419c11d6-78f3-4bf4-bf63-f9de52f824dc tempest-VolumesNegativeTest-956911451 tempest-VolumesNegativeTest-956911451-project] Action: 'create', calling method: .version_select at 0x7f217d715268>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1308467997", "metadata": {"Type": "work"}}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:34:06.508280 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-419c11d6-78f3-4bf4-bf63-f9de52f824dc tempest-VolumesNegativeTest-956911451 tempest-VolumesNegativeTest-956911451-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=98194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:34:06.509144 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-419c11d6-78f3-4bf4-bf63-f9de52f824dc tempest-VolumesNegativeTest-956911451 tempest-VolumesNegativeTest-956911451-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007333 Feb 19 02:34:06.509714 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 494/996] 10.222.0.44 () {60 vars in 1146 bytes} [Fri Feb 19 02:34:06 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 19 02:34:06.519262 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ae78b595-05cc-48f3-b28a-a2b4d9fdcf29 tempest-VolumesNegativeTest-956911451 tempest-VolumesNegativeTest-956911451-project] Calling method '.version_select at 0x7f217c4e98c8>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:06.586613 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-ae78b595-05cc-48f3-b28a-a2b4d9fdcf29 tempest-VolumesNegativeTest-956911451 tempest-VolumesNegativeTest-956911451-project] HTTP exception thrown: Volume tempest-invalid-1271833436 could not be found. Feb 19 02:34:06.587285 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ae78b595-05cc-48f3-b28a-a2b4d9fdcf29 tempest-VolumesNegativeTest-956911451 tempest-VolumesNegativeTest-956911451-project] Returning 404 to user: Volume tempest-invalid-1271833436 could not be found. {{(pid=98193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:34:06.588191 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ae78b595-05cc-48f3-b28a-a2b4d9fdcf29 tempest-VolumesNegativeTest-956911451 tempest-VolumesNegativeTest-956911451-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1271833436" status: 404 len: 99 microversion: 2.1 time: 0.072875 Feb 19 02:34:06.588800 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 503/997] 10.222.0.44 () {58 vars in 1208 bytes} [Fri Feb 19 02:34:06 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1271833436 => generated 99 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 19 02:34:06.598641 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f19d50f3-7d36-4d9d-b7b5-4060ae223fe8 tempest-VolumesNegativeTest-956911451 tempest-VolumesNegativeTest-956911451-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003936 Feb 19 02:34:06.599180 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 495/998] 10.222.0.44 () {58 vars in 1130 bytes} [Fri Feb 19 02:34:06 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 19 02:34:06.608841 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-af05fff0-3fd1-4d68-9ab8-96909a21d600 tempest-VolumesNegativeTest-956911451 tempest-VolumesNegativeTest-956911451-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003782 Feb 19 02:34:06.609574 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 504/999] 10.222.0.44 () {58 vars in 1127 bytes} [Fri Feb 19 02:34:06 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 19 02:34:06.619199 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-0967bdd3-6059-4a75-ac10-9fcdb0d26370 tempest-VolumesNegativeTest-956911451 tempest-VolumesNegativeTest-956911451-project] Calling method '.version_select at 0x7f217d6f3950>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:06.807613 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-0967bdd3-6059-4a75-ac10-9fcdb0d26370 tempest-VolumesNegativeTest-956911451 tempest-VolumesNegativeTest-956911451-project] HTTP exception thrown: Volume e6747d6b-b3df-4c0c-a9dc-aa6ec195275f could not be found. Feb 19 02:34:06.808383 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-0967bdd3-6059-4a75-ac10-9fcdb0d26370 tempest-VolumesNegativeTest-956911451 tempest-VolumesNegativeTest-956911451-project] Returning 404 to user: Volume e6747d6b-b3df-4c0c-a9dc-aa6ec195275f could not be found. {{(pid=98194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:34:06.809373 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-0967bdd3-6059-4a75-ac10-9fcdb0d26370 tempest-VolumesNegativeTest-956911451 tempest-VolumesNegativeTest-956911451-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/e6747d6b-b3df-4c0c-a9dc-aa6ec195275f" status: 404 len: 109 microversion: 2.1 time: 0.194088 Feb 19 02:34:06.810093 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 496/1000] 10.222.0.44 () {58 vars in 1238 bytes} [Fri Feb 19 02:34:06 2021] DELETE /compute/v2.1/os-volumes/e6747d6b-b3df-4c0c-a9dc-aa6ec195275f => generated 109 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 02:34:06.820252 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-64a7f90f-ad16-41b0-8ef6-ef71d3ff29f6 tempest-VolumesNegativeTest-956911451 tempest-VolumesNegativeTest-956911451-project] Calling method '.version_select at 0x7f217c4150d0>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:06.884222 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-64a7f90f-ad16-41b0-8ef6-ef71d3ff29f6 tempest-VolumesNegativeTest-956911451 tempest-VolumesNegativeTest-956911451-project] HTTP exception thrown: Volume e8137e9d-308f-479a-a458-901a1a402c30 could not be found. Feb 19 02:34:06.884928 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-64a7f90f-ad16-41b0-8ef6-ef71d3ff29f6 tempest-VolumesNegativeTest-956911451 tempest-VolumesNegativeTest-956911451-project] Returning 404 to user: Volume e8137e9d-308f-479a-a458-901a1a402c30 could not be found. {{(pid=98193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:34:06.885771 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-64a7f90f-ad16-41b0-8ef6-ef71d3ff29f6 tempest-VolumesNegativeTest-956911451 tempest-VolumesNegativeTest-956911451-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/e8137e9d-308f-479a-a458-901a1a402c30" status: 404 len: 109 microversion: 2.1 time: 0.069545 Feb 19 02:34:06.886382 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 505/1001] 10.222.0.44 () {58 vars in 1235 bytes} [Fri Feb 19 02:34:06 2021] GET /compute/v2.1/os-volumes/e8137e9d-308f-479a-a458-901a1a402c30 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 02:34:36.597227 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-aa8b0a11-50a5-4c90-b75f-18b0681eab58 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-TestMinimumBasicScenario-1734754259"}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:34:36.597800 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-aa8b0a11-50a5-4c90-b75f-18b0681eab58 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:34:36.605815 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-aa8b0a11-50a5-4c90-b75f-18b0681eab58 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:36.606321 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-aa8b0a11-50a5-4c90-b75f-18b0681eab58 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:36.607202 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-aa8b0a11-50a5-4c90-b75f-18b0681eab58 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:36.607670 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-aa8b0a11-50a5-4c90-b75f-18b0681eab58 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:36.812848 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.network.security_group_api [None req-aa8b0a11-50a5-4c90-b75f-18b0681eab58 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Removing security group c3045f51-a241-4ad3-81a3-c9120a6b039a from port 2d39a22b-39a7-4bd0-b9ae-911a223833df Feb 19 02:34:37.590609 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-aa8b0a11-50a5-4c90-b75f-18b0681eab58 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "POST /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/action" status: 202 len: 0 microversion: 2.1 time: 0.999456 Feb 19 02:34:37.592039 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 497/1002] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:34:36 2021] POST /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/action => generated 0 bytes in 1002 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:34:37.598991 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-196cd60a-a80c-48f4-8c8b-b3b0a16b4840 req-5422480d-d620-4d1f-ae5b-1ac97f41debf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec6a4f24-919b-4160-9c5f-07d6513e1e08", "tag": "2d39a22b-39a7-4bd0-b9ae-911a223833df"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:34:37.600700 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:34:37.600700 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:34:37.602069 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-205f50ff-cc08-4bef-a3b1-2806af09405b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '.version_select at 0x7f21816fe7b8>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:37.611601 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-196cd60a-a80c-48f4-8c8b-b3b0a16b4840 req-5422480d-d620-4d1f-ae5b-1ac97f41debf service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:37.612340 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-196cd60a-a80c-48f4-8c8b-b3b0a16b4840 req-5422480d-d620-4d1f-ae5b-1ac97f41debf service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:37.641291 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-196cd60a-a80c-48f4-8c8b-b3b0a16b4840 req-5422480d-d620-4d1f-ae5b-1ac97f41debf service nova] Creating event network-changed:2d39a22b-39a7-4bd0-b9ae-911a223833df for instance ec6a4f24-919b-4160-9c5f-07d6513e1e08 on hv-cinder-77642 Feb 19 02:34:37.647631 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-196cd60a-a80c-48f4-8c8b-b3b0a16b4840 req-5422480d-d620-4d1f-ae5b-1ac97f41debf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052650 Feb 19 02:34:37.648510 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 506/1003] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:34:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:34:37.884255 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-205f50ff-cc08-4bef-a3b1-2806af09405b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/c3045f51-a241-4ad3-81a3-c9120a6b039a" status: 202 len: 0 microversion: 2.1 time: 0.287697 Feb 19 02:34:37.885118 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 498/1004] 10.222.0.44 () {58 vars in 1262 bytes} [Fri Feb 19 02:34:37 2021] DELETE /compute/v2.1/os-security-groups/c3045f51-a241-4ad3-81a3-c9120a6b039a => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 19 02:34:37.895738 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-dd625929-c3ac-4ab2-9d9d-bb97535c71af tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '.version_select at 0x7f217d61e378>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:39.126286 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-dd625929-c3ac-4ab2-9d9d-bb97535c71af tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:34:39.137222 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dd625929-c3ac-4ab2-9d9d-bb97535c71af tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:39.137947 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dd625929-c3ac-4ab2-9d9d-bb97535c71af tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:39.139060 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dd625929-c3ac-4ab2-9d9d-bb97535c71af tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:39.139560 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dd625929-c3ac-4ab2-9d9d-bb97535c71af tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:39.212426 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dd625929-c3ac-4ab2-9d9d-bb97535c71af tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Acquired lock "refresh_cache-ec6a4f24-919b-4160-9c5f-07d6513e1e08" {{(pid=98193) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 19 02:34:41.416156 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-dd625929-c3ac-4ab2-9d9d-bb97535c71af tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Building network info cache for instance {{(pid=98193) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 19 02:34:41.425415 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-3f63aa8a-8c48-4f4a-803c-8f6fcd1d6ea0 req-b8098d58-f7a9-4b98-b780-11d9260783b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec6a4f24-919b-4160-9c5f-07d6513e1e08", "tag": "2d39a22b-39a7-4bd0-b9ae-911a223833df"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:34:41.427181 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:34:41.427181 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:34:41.441158 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-3f63aa8a-8c48-4f4a-803c-8f6fcd1d6ea0 req-b8098d58-f7a9-4b98-b780-11d9260783b3 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:41.442053 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-3f63aa8a-8c48-4f4a-803c-8f6fcd1d6ea0 req-b8098d58-f7a9-4b98-b780-11d9260783b3 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:41.462855 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-3f63aa8a-8c48-4f4a-803c-8f6fcd1d6ea0 req-b8098d58-f7a9-4b98-b780-11d9260783b3 service nova] Creating event network-changed:2d39a22b-39a7-4bd0-b9ae-911a223833df for instance ec6a4f24-919b-4160-9c5f-07d6513e1e08 on hv-cinder-77642 Feb 19 02:34:41.473384 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-3f63aa8a-8c48-4f4a-803c-8f6fcd1d6ea0 req-b8098d58-f7a9-4b98-b780-11d9260783b3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051800 Feb 19 02:34:41.474594 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 499/1005] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:34:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:34:42.285410 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-dd625929-c3ac-4ab2-9d9d-bb97535c71af tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Updating instance_info_cache with network_info: [{"id": "2d39a22b-39a7-4bd0-b9ae-911a223833df", "address": "fa:16:3e:76:8d:46", "network": {"id": "44a41470-32cc-4220-b6d8-4fa5cdef8de0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-576736226-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ed76decd92fc4f23bf841fd8f151e05c", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap2d39a22b-39", "ovs_interfaceid": "2d39a22b-39a7-4bd0-b9ae-911a223833df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98193) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 19 02:34:42.298408 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dd625929-c3ac-4ab2-9d9d-bb97535c71af tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Releasing lock "refresh_cache-ec6a4f24-919b-4160-9c5f-07d6513e1e08" {{(pid=98193) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 19 02:34:42.299535 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-dd625929-c3ac-4ab2-9d9d-bb97535c71af tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "DELETE /compute/v2.1/os-floating-ips/33eb8a62-b763-4aa2-b277-c03f9aff9684" status: 202 len: 0 microversion: 2.1 time: 4.409667 Feb 19 02:34:42.300365 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 507/1006] 10.222.0.44 () {58 vars in 1253 bytes} [Fri Feb 19 02:34:37 2021] DELETE /compute/v2.1/os-floating-ips/33eb8a62-b763-4aa2-b277-c03f9aff9684 => generated 0 bytes in 4411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:34:42.310487 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-76497de3-2354-4eb0-94a1-6f41bc920266 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:42.311588 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-76497de3-2354-4eb0-94a1-6f41bc920266 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:34:42.321294 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-76497de3-2354-4eb0-94a1-6f41bc920266 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:42.322031 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-76497de3-2354-4eb0-94a1-6f41bc920266 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:42.323174 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-76497de3-2354-4eb0-94a1-6f41bc920266 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:42.323748 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-76497de3-2354-4eb0-94a1-6f41bc920266 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:42.508515 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.objects.instance [None req-76497de3-2354-4eb0-94a1-6f41bc920266 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lazy-loading 'services' on Instance uuid ec6a4f24-919b-4160-9c5f-07d6513e1e08 {{(pid=98194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 02:34:42.660278 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-76497de3-2354-4eb0-94a1-6f41bc920266 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments/f58ec49d-b2a1-4303-814c-838fdb27a7b2" status: 202 len: 0 microversion: 2.1 time: 0.354645 Feb 19 02:34:42.661065 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 500/1007] 10.222.0.44 () {58 vars in 1406 bytes} [Fri Feb 19 02:34:42 2021] DELETE /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments/f58ec49d-b2a1-4303-814c-838fdb27a7b2 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:34:42.669800 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a32526ac-5146-4b60-a796-92cdaad236a7 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:42.670944 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a32526ac-5146-4b60-a796-92cdaad236a7 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:34:42.679893 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a32526ac-5146-4b60-a796-92cdaad236a7 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:42.683238 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a32526ac-5146-4b60-a796-92cdaad236a7 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:42.684595 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a32526ac-5146-4b60-a796-92cdaad236a7 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:42.685225 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a32526ac-5146-4b60-a796-92cdaad236a7 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:42.757118 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a32526ac-5146-4b60-a796-92cdaad236a7 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091304 Feb 19 02:34:42.757954 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 508/1008] 10.222.0.44 () {58 vars in 1292 bytes} [Fri Feb 19 02:34:42 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:34:43.772436 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-cb89ed38-9c27-46d4-b67a-79a76c800cfc tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:43.773710 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-cb89ed38-9c27-46d4-b67a-79a76c800cfc tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:34:43.796944 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cb89ed38-9c27-46d4-b67a-79a76c800cfc tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:43.797568 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cb89ed38-9c27-46d4-b67a-79a76c800cfc tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:43.798610 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cb89ed38-9c27-46d4-b67a-79a76c800cfc tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:43.799299 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-cb89ed38-9c27-46d4-b67a-79a76c800cfc tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:43.923891 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-cb89ed38-9c27-46d4-b67a-79a76c800cfc tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158149 Feb 19 02:34:43.932689 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 501/1009] 10.222.0.44 () {58 vars in 1292 bytes} [Fri Feb 19 02:34:43 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:34:44.935943 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ba3b3275-4c26-433c-b3f2-fd6ec5aeb45f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:44.936993 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ba3b3275-4c26-433c-b3f2-fd6ec5aeb45f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:34:44.944987 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ba3b3275-4c26-433c-b3f2-fd6ec5aeb45f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:44.945488 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ba3b3275-4c26-433c-b3f2-fd6ec5aeb45f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:44.946310 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ba3b3275-4c26-433c-b3f2-fd6ec5aeb45f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:44.946819 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ba3b3275-4c26-433c-b3f2-fd6ec5aeb45f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:45.015472 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ba3b3275-4c26-433c-b3f2-fd6ec5aeb45f tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083709 Feb 19 02:34:45.016093 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 509/1010] 10.222.0.44 () {58 vars in 1292 bytes} [Fri Feb 19 02:34:44 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:34:46.027050 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-319ff63f-c5c3-417f-8b7c-e8f8619d8bf7 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:46.028183 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-319ff63f-c5c3-417f-8b7c-e8f8619d8bf7 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:34:46.036787 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-319ff63f-c5c3-417f-8b7c-e8f8619d8bf7 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:46.037288 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-319ff63f-c5c3-417f-8b7c-e8f8619d8bf7 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:46.038111 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-319ff63f-c5c3-417f-8b7c-e8f8619d8bf7 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:46.038621 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-319ff63f-c5c3-417f-8b7c-e8f8619d8bf7 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:46.106931 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-319ff63f-c5c3-417f-8b7c-e8f8619d8bf7 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083874 Feb 19 02:34:46.107537 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 502/1011] 10.222.0.44 () {58 vars in 1292 bytes} [Fri Feb 19 02:34:46 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:34:47.119549 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-2abb6edf-cf53-4ef1-a5d8-82cf0ade8d17 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:47.120574 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-2abb6edf-cf53-4ef1-a5d8-82cf0ade8d17 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:34:47.128352 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2abb6edf-cf53-4ef1-a5d8-82cf0ade8d17 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:47.128851 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2abb6edf-cf53-4ef1-a5d8-82cf0ade8d17 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:47.129671 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2abb6edf-cf53-4ef1-a5d8-82cf0ade8d17 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:47.130154 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2abb6edf-cf53-4ef1-a5d8-82cf0ade8d17 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:47.199520 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-2abb6edf-cf53-4ef1-a5d8-82cf0ade8d17 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084023 Feb 19 02:34:47.200129 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 510/1012] 10.222.0.44 () {58 vars in 1292 bytes} [Fri Feb 19 02:34:47 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:34:48.212691 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c3b22a55-e75f-4d5b-92a4-500f355bdc7d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:48.213775 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c3b22a55-e75f-4d5b-92a4-500f355bdc7d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:34:48.222200 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c3b22a55-e75f-4d5b-92a4-500f355bdc7d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:48.222717 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c3b22a55-e75f-4d5b-92a4-500f355bdc7d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:48.223553 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c3b22a55-e75f-4d5b-92a4-500f355bdc7d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:48.224043 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c3b22a55-e75f-4d5b-92a4-500f355bdc7d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:48.290388 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c3b22a55-e75f-4d5b-92a4-500f355bdc7d tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082750 Feb 19 02:34:48.291007 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 503/1013] 10.222.0.44 () {58 vars in 1292 bytes} [Fri Feb 19 02:34:48 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:34:49.303059 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c9810068-4b53-4e7e-a974-80e7100ffe64 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:49.304094 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c9810068-4b53-4e7e-a974-80e7100ffe64 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:34:49.311977 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c9810068-4b53-4e7e-a974-80e7100ffe64 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:49.312462 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c9810068-4b53-4e7e-a974-80e7100ffe64 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:49.313734 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c9810068-4b53-4e7e-a974-80e7100ffe64 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:49.313845 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c9810068-4b53-4e7e-a974-80e7100ffe64 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:49.381463 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c9810068-4b53-4e7e-a974-80e7100ffe64 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082536 Feb 19 02:34:49.382051 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 511/1014] 10.222.0.44 () {58 vars in 1292 bytes} [Fri Feb 19 02:34:49 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:34:49.494538 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1823a708-ff63-4da3-be01-b556832cc85b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '.version_select at 0x7f21816fe268>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:49.990524 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1823a708-ff63-4da3-be01-b556832cc85b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:34:49.998495 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1823a708-ff63-4da3-be01-b556832cc85b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:49.999004 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1823a708-ff63-4da3-be01-b556832cc85b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:49.999854 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1823a708-ff63-4da3-be01-b556832cc85b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:50.000340 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1823a708-ff63-4da3-be01-b556832cc85b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:50.065831 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1823a708-ff63-4da3-be01-b556832cc85b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Acquired lock "refresh_cache-900317e8-8e9d-49e0-927b-a4d30c204f2c" {{(pid=98194) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 19 02:34:50.394519 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-60fed31d-0af6-4f5d-ac6e-761593f4ab84 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:50.395611 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-60fed31d-0af6-4f5d-ac6e-761593f4ab84 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:34:50.403405 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-60fed31d-0af6-4f5d-ac6e-761593f4ab84 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:50.403914 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-60fed31d-0af6-4f5d-ac6e-761593f4ab84 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:50.404757 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-60fed31d-0af6-4f5d-ac6e-761593f4ab84 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:50.405229 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-60fed31d-0af6-4f5d-ac6e-761593f4ab84 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:50.474054 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-60fed31d-0af6-4f5d-ac6e-761593f4ab84 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084298 Feb 19 02:34:50.474637 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 512/1015] 10.222.0.44 () {58 vars in 1292 bytes} [Fri Feb 19 02:34:50 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:34:51.486664 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e1db7f3d-95a1-4b94-ad43-77c75e94216a tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:51.487886 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e1db7f3d-95a1-4b94-ad43-77c75e94216a tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:34:51.496477 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e1db7f3d-95a1-4b94-ad43-77c75e94216a tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:51.496615 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e1db7f3d-95a1-4b94-ad43-77c75e94216a tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:51.497375 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e1db7f3d-95a1-4b94-ad43-77c75e94216a tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:51.497872 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e1db7f3d-95a1-4b94-ad43-77c75e94216a tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:51.566224 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e1db7f3d-95a1-4b94-ad43-77c75e94216a tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083847 Feb 19 02:34:51.566877 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 513/1016] 10.222.0.44 () {58 vars in 1292 bytes} [Fri Feb 19 02:34:51 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:34:52.025530 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-1823a708-ff63-4da3-be01-b556832cc85b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Building network info cache for instance {{(pid=98194) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 19 02:34:52.036470 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-bf311888-878f-41db-b8fa-180de0084090 req-1e658506-cbcd-4d27-bff0-eb34a2c7bd9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "900317e8-8e9d-49e0-927b-a4d30c204f2c", "tag": "9b55214e-d4a5-4d7f-a090-48b12fdd6991"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:34:52.038281 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:34:52.038281 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:34:52.047265 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-bf311888-878f-41db-b8fa-180de0084090 req-1e658506-cbcd-4d27-bff0-eb34a2c7bd9f service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:52.048805 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-bf311888-878f-41db-b8fa-180de0084090 req-1e658506-cbcd-4d27-bff0-eb34a2c7bd9f service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:52.069733 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-bf311888-878f-41db-b8fa-180de0084090 req-1e658506-cbcd-4d27-bff0-eb34a2c7bd9f service nova] Creating event network-changed:9b55214e-d4a5-4d7f-a090-48b12fdd6991 for instance 900317e8-8e9d-49e0-927b-a4d30c204f2c on hv-cinder-77642 Feb 19 02:34:52.077586 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-bf311888-878f-41db-b8fa-180de0084090 req-1e658506-cbcd-4d27-bff0-eb34a2c7bd9f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045732 Feb 19 02:34:52.078562 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 514/1017] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:34:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:34:52.579717 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-36b50cb5-0484-4ed7-ad4b-02f88703e245 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:52.581559 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-36b50cb5-0484-4ed7-ad4b-02f88703e245 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:34:52.591271 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-36b50cb5-0484-4ed7-ad4b-02f88703e245 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:52.592257 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-36b50cb5-0484-4ed7-ad4b-02f88703e245 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:52.593268 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-36b50cb5-0484-4ed7-ad4b-02f88703e245 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:52.593833 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-36b50cb5-0484-4ed7-ad4b-02f88703e245 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:52.727713 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-36b50cb5-0484-4ed7-ad4b-02f88703e245 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154002 Feb 19 02:34:52.728663 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 515/1018] 10.222.0.44 () {58 vars in 1292 bytes} [Fri Feb 19 02:34:52 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:34:52.966881 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-1823a708-ff63-4da3-be01-b556832cc85b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Updating instance_info_cache with network_info: [{"id": "9b55214e-d4a5-4d7f-a090-48b12fdd6991", "address": "fa:16:3e:74:f5:e0", "network": {"id": "1a196cc5-5370-49d8-b297-9862ae510cb8", "bridge": "br-int", "label": "tempest-TestShelveInstance-336767559-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e134d1a72aee466e8636d06121d39c09", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap9b55214e-d4", "ovs_interfaceid": "9b55214e-d4a5-4d7f-a090-48b12fdd6991", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98194) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 19 02:34:52.975561 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1823a708-ff63-4da3-be01-b556832cc85b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Releasing lock "refresh_cache-900317e8-8e9d-49e0-927b-a4d30c204f2c" {{(pid=98194) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 19 02:34:52.976629 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1823a708-ff63-4da3-be01-b556832cc85b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "DELETE /compute/v2.1/os-floating-ips/e3b0810c-74d8-4003-a582-fca2ac3245ed" status: 202 len: 0 microversion: 2.1 time: 3.669781 Feb 19 02:34:52.977336 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 504/1019] 10.222.0.44 () {58 vars in 1253 bytes} [Fri Feb 19 02:34:49 2021] DELETE /compute/v2.1/os-floating-ips/e3b0810c-74d8-4003-a582-fca2ac3245ed => generated 0 bytes in 3671 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:34:52.986669 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-0f297c45-004e-4110-9d89-f563513cd0c6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:52.987276 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-0f297c45-004e-4110-9d89-f563513cd0c6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:34:52.995249 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0f297c45-004e-4110-9d89-f563513cd0c6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:52.995863 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0f297c45-004e-4110-9d89-f563513cd0c6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:52.996769 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0f297c45-004e-4110-9d89-f563513cd0c6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:52.997330 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0f297c45-004e-4110-9d89-f563513cd0c6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:53.062533 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-0f297c45-004e-4110-9d89-f563513cd0c6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Going to try to terminate instance {{(pid=98193) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 02:34:53.183729 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-0f297c45-004e-4110-9d89-f563513cd0c6 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "DELETE /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 204 len: 0 microversion: 2.1 time: 0.201267 Feb 19 02:34:53.184516 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 516/1020] 10.222.0.44 () {58 vars in 1229 bytes} [Fri Feb 19 02:34:52 2021] DELETE /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 02:34:53.193992 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-2c515421-5ccf-4cb2-9099-c43c5a16c4ee tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:53.194944 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-2c515421-5ccf-4cb2-9099-c43c5a16c4ee tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:34:53.202866 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2c515421-5ccf-4cb2-9099-c43c5a16c4ee tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:53.203650 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2c515421-5ccf-4cb2-9099-c43c5a16c4ee tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:53.204476 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2c515421-5ccf-4cb2-9099-c43c5a16c4ee tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:53.204962 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2c515421-5ccf-4cb2-9099-c43c5a16c4ee tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:53.439822 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-2c515421-5ccf-4cb2-9099-c43c5a16c4ee tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:34:53.448779 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-2c515421-5ccf-4cb2-9099-c43c5a16c4ee tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1454 microversion: 2.1 time: 0.258885 Feb 19 02:34:53.449406 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 505/1021] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:34:53 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1454 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:34:53.744231 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-9ef9dc72-5c83-4483-8f77-3db674dacf1e tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:53.744231 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-9ef9dc72-5c83-4483-8f77-3db674dacf1e tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:34:53.750848 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9ef9dc72-5c83-4483-8f77-3db674dacf1e tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:53.751350 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9ef9dc72-5c83-4483-8f77-3db674dacf1e tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:53.752187 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9ef9dc72-5c83-4483-8f77-3db674dacf1e tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:53.752674 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9ef9dc72-5c83-4483-8f77-3db674dacf1e tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:53.825195 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-9ef9dc72-5c83-4483-8f77-3db674dacf1e tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088418 Feb 19 02:34:53.825852 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 517/1022] 10.222.0.44 () {58 vars in 1292 bytes} [Fri Feb 19 02:34:53 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:34:54.470069 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-9a7700a1-0dc6-4ca7-b94e-872490841f3d tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:54.470769 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-9a7700a1-0dc6-4ca7-b94e-872490841f3d tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:34:54.478550 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a7700a1-0dc6-4ca7-b94e-872490841f3d tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:54.479052 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a7700a1-0dc6-4ca7-b94e-872490841f3d tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:54.479874 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a7700a1-0dc6-4ca7-b94e-872490841f3d tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:54.480361 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a7700a1-0dc6-4ca7-b94e-872490841f3d tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:54.690000 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9a7700a1-0dc6-4ca7-b94e-872490841f3d tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:34:54.698789 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-9a7700a1-0dc6-4ca7-b94e-872490841f3d tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1454 microversion: 2.1 time: 0.233133 Feb 19 02:34:54.699415 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 506/1023] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:34:54 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1454 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:34:54.837535 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-32eb0a0d-3f11-454f-9733-b8912572497c tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:54.838608 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-32eb0a0d-3f11-454f-9733-b8912572497c tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:34:54.846631 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-32eb0a0d-3f11-454f-9733-b8912572497c tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:54.847145 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-32eb0a0d-3f11-454f-9733-b8912572497c tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:54.847986 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-32eb0a0d-3f11-454f-9733-b8912572497c tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:54.848480 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-32eb0a0d-3f11-454f-9733-b8912572497c tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:54.916020 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-32eb0a0d-3f11-454f-9733-b8912572497c tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082487 Feb 19 02:34:54.917385 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 518/1024] 10.222.0.44 () {58 vars in 1292 bytes} [Fri Feb 19 02:34:54 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:34:55.717363 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e38a5621-e19e-427d-8e87-a31fb474a2e4 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:55.718042 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e38a5621-e19e-427d-8e87-a31fb474a2e4 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:34:55.726407 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e38a5621-e19e-427d-8e87-a31fb474a2e4 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:55.726917 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e38a5621-e19e-427d-8e87-a31fb474a2e4 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:55.727752 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e38a5621-e19e-427d-8e87-a31fb474a2e4 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:55.728246 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e38a5621-e19e-427d-8e87-a31fb474a2e4 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:55.929247 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5e52f434-b927-46b3-9036-f5d5e3a906d4 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:55.931028 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5e52f434-b927-46b3-9036-f5d5e3a906d4 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:34:55.940110 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5e52f434-b927-46b3-9036-f5d5e3a906d4 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:55.940620 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5e52f434-b927-46b3-9036-f5d5e3a906d4 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:55.941508 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5e52f434-b927-46b3-9036-f5d5e3a906d4 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:55.941993 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5e52f434-b927-46b3-9036-f5d5e3a906d4 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:55.946523 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e38a5621-e19e-427d-8e87-a31fb474a2e4 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:34:55.955970 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e38a5621-e19e-427d-8e87-a31fb474a2e4 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1454 microversion: 2.1 time: 0.242628 Feb 19 02:34:55.956778 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 507/1025] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:34:55 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1454 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:34:56.010901 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5e52f434-b927-46b3-9036-f5d5e3a906d4 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086047 Feb 19 02:34:56.011514 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 519/1026] 10.222.0.44 () {58 vars in 1292 bytes} [Fri Feb 19 02:34:55 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:34:56.974096 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d95ccc7a-ea2f-4a93-8d07-2b3c5ff429bb tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:56.974791 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d95ccc7a-ea2f-4a93-8d07-2b3c5ff429bb tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:34:56.993433 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d95ccc7a-ea2f-4a93-8d07-2b3c5ff429bb tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:56.995084 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d95ccc7a-ea2f-4a93-8d07-2b3c5ff429bb tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:56.996209 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d95ccc7a-ea2f-4a93-8d07-2b3c5ff429bb tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:56.996822 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d95ccc7a-ea2f-4a93-8d07-2b3c5ff429bb tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:57.023234 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-89cf4f97-94cc-4a33-adff-57768aa4ef1b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:57.024518 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-89cf4f97-94cc-4a33-adff-57768aa4ef1b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:34:57.033252 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-89cf4f97-94cc-4a33-adff-57768aa4ef1b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:57.033969 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-89cf4f97-94cc-4a33-adff-57768aa4ef1b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:57.035013 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-89cf4f97-94cc-4a33-adff-57768aa4ef1b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:57.037771 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-89cf4f97-94cc-4a33-adff-57768aa4ef1b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:57.123911 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-89cf4f97-94cc-4a33-adff-57768aa4ef1b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.104772 Feb 19 02:34:57.124722 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 520/1027] 10.222.0.44 () {58 vars in 1292 bytes} [Fri Feb 19 02:34:57 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 19 02:34:57.136281 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a05b41f2-ce20-40b8-8e5f-701ec5159b5c tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:57.137296 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a05b41f2-ce20-40b8-8e5f-701ec5159b5c tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:34:57.145413 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a05b41f2-ce20-40b8-8e5f-701ec5159b5c tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:57.145747 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a05b41f2-ce20-40b8-8e5f-701ec5159b5c tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:57.146639 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a05b41f2-ce20-40b8-8e5f-701ec5159b5c tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:57.147397 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a05b41f2-ce20-40b8-8e5f-701ec5159b5c tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:57.238206 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-d95ccc7a-ea2f-4a93-8d07-2b3c5ff429bb tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:34:57.267082 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d95ccc7a-ea2f-4a93-8d07-2b3c5ff429bb tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1454 microversion: 2.1 time: 0.297773 Feb 19 02:34:57.267734 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 508/1028] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:34:56 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1454 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:34:57.323177 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-a05b41f2-ce20-40b8-8e5f-701ec5159b5c tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] HTTP exception thrown: Instance ec6a4f24-919b-4160-9c5f-07d6513e1e08 is not attached to volume f58ec49d-b2a1-4303-814c-838fdb27a7b2 Feb 19 02:34:57.323829 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a05b41f2-ce20-40b8-8e5f-701ec5159b5c tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Returning 404 to user: Instance ec6a4f24-919b-4160-9c5f-07d6513e1e08 is not attached to volume f58ec49d-b2a1-4303-814c-838fdb27a7b2 {{(pid=98193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:34:57.324744 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a05b41f2-ce20-40b8-8e5f-701ec5159b5c tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments/f58ec49d-b2a1-4303-814c-838fdb27a7b2" status: 404 len: 154 microversion: 2.1 time: 0.193375 Feb 19 02:34:57.325533 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 521/1029] 10.222.0.44 () {58 vars in 1406 bytes} [Fri Feb 19 02:34:57 2021] DELETE /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08/os-volume_attachments/f58ec49d-b2a1-4303-814c-838fdb27a7b2 => generated 154 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 02:34:57.724012 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-99f0c676-df3e-41f7-bfa6-521ddb8e08d5 req-3ea785d0-719c-496b-8f32-ebecf34374be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "900317e8-8e9d-49e0-927b-a4d30c204f2c", "name": "network-vif-unplugged", "status": "completed", "tag": "9b55214e-d4a5-4d7f-a090-48b12fdd6991"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:34:57.728471 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:34:57.728471 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:34:57.742173 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-99f0c676-df3e-41f7-bfa6-521ddb8e08d5 req-3ea785d0-719c-496b-8f32-ebecf34374be service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:57.742927 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-99f0c676-df3e-41f7-bfa6-521ddb8e08d5 req-3ea785d0-719c-496b-8f32-ebecf34374be service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:57.766406 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-99f0c676-df3e-41f7-bfa6-521ddb8e08d5 req-3ea785d0-719c-496b-8f32-ebecf34374be service nova] Creating event network-vif-unplugged:9b55214e-d4a5-4d7f-a090-48b12fdd6991 for instance 900317e8-8e9d-49e0-927b-a4d30c204f2c on hv-cinder-77642 Feb 19 02:34:57.774408 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-99f0c676-df3e-41f7-bfa6-521ddb8e08d5 req-3ea785d0-719c-496b-8f32-ebecf34374be service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055714 Feb 19 02:34:57.776003 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 509/1030] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:34:57 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:34:58.286837 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ff1b0063-e669-4928-a42c-7752259b137b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:58.287447 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ff1b0063-e669-4928-a42c-7752259b137b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:34:58.295377 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ff1b0063-e669-4928-a42c-7752259b137b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:58.295881 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ff1b0063-e669-4928-a42c-7752259b137b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:58.296714 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ff1b0063-e669-4928-a42c-7752259b137b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:58.297204 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ff1b0063-e669-4928-a42c-7752259b137b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:58.506660 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ff1b0063-e669-4928-a42c-7752259b137b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:34:58.515651 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ff1b0063-e669-4928-a42c-7752259b137b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1454 microversion: 2.1 time: 0.233637 Feb 19 02:34:58.516920 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 522/1031] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:34:58 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1454 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:34:58.598302 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-660dbbb6-c07c-4deb-ada8-3887a74d3d5b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:58.599037 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-660dbbb6-c07c-4deb-ada8-3887a74d3d5b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:34:58.607402 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-660dbbb6-c07c-4deb-ada8-3887a74d3d5b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:58.607911 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-660dbbb6-c07c-4deb-ada8-3887a74d3d5b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:58.608749 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-660dbbb6-c07c-4deb-ada8-3887a74d3d5b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:58.609239 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-660dbbb6-c07c-4deb-ada8-3887a74d3d5b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:58.676488 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-660dbbb6-c07c-4deb-ada8-3887a74d3d5b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Going to try to terminate instance {{(pid=98194) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 02:34:58.793124 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-660dbbb6-c07c-4deb-ada8-3887a74d3d5b tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 204 len: 0 microversion: 2.1 time: 0.198974 Feb 19 02:34:58.793912 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 510/1032] 10.222.0.44 () {58 vars in 1229 bytes} [Fri Feb 19 02:34:58 2021] DELETE /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 02:34:58.802596 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e0ed87db-ac8e-49b8-a694-b3cbb639f630 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:58.803260 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e0ed87db-ac8e-49b8-a694-b3cbb639f630 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:34:58.811323 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e0ed87db-ac8e-49b8-a694-b3cbb639f630 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:58.811803 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e0ed87db-ac8e-49b8-a694-b3cbb639f630 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:58.813348 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e0ed87db-ac8e-49b8-a694-b3cbb639f630 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:58.813834 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e0ed87db-ac8e-49b8-a694-b3cbb639f630 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:59.443021 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-88717643-9c9d-4240-8e9a-4faf92c5c06f req-d6f418be-b4c9-4ce3-9f09-b5229634f0b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "900317e8-8e9d-49e0-927b-a4d30c204f2c", "name": "network-vif-deleted", "tag": "9b55214e-d4a5-4d7f-a090-48b12fdd6991"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:34:59.445192 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:34:59.445192 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:34:59.455902 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-88717643-9c9d-4240-8e9a-4faf92c5c06f req-d6f418be-b4c9-4ce3-9f09-b5229634f0b7 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:59.456390 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-88717643-9c9d-4240-8e9a-4faf92c5c06f req-d6f418be-b4c9-4ce3-9f09-b5229634f0b7 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:59.475128 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e0ed87db-ac8e-49b8-a694-b3cbb639f630 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:34:59.476270 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-88717643-9c9d-4240-8e9a-4faf92c5c06f req-d6f418be-b4c9-4ce3-9f09-b5229634f0b7 service nova] Creating event network-vif-deleted:9b55214e-d4a5-4d7f-a090-48b12fdd6991 for instance 900317e8-8e9d-49e0-927b-a4d30c204f2c on hv-cinder-77642 Feb 19 02:34:59.481352 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-88717643-9c9d-4240-8e9a-4faf92c5c06f req-d6f418be-b4c9-4ce3-9f09-b5229634f0b7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042608 Feb 19 02:34:59.481938 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 511/1033] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:34:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:34:59.488292 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e0ed87db-ac8e-49b8-a694-b3cbb639f630 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1553 microversion: 2.1 time: 0.688570 Feb 19 02:34:59.489382 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 523/1034] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:34:58 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1553 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:34:59.535619 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8e300def-7d85-41ac-86b6-26f7a25c097b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:34:59.536366 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8e300def-7d85-41ac-86b6-26f7a25c097b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:34:59.544572 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8e300def-7d85-41ac-86b6-26f7a25c097b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:59.545075 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8e300def-7d85-41ac-86b6-26f7a25c097b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:59.546098 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8e300def-7d85-41ac-86b6-26f7a25c097b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:34:59.546553 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8e300def-7d85-41ac-86b6-26f7a25c097b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:34:59.699075 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8e300def-7d85-41ac-86b6-26f7a25c097b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a9445a66a3485b92b1d2e8b3c8ce33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e134d1a72aee466e8636d06121d39c09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:34:59.708791 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8e300def-7d85-41ac-86b6-26f7a25c097b tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 200 len: 1219 microversion: 2.1 time: 0.178384 Feb 19 02:34:59.709424 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 512/1035] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:34:59 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 1219 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:35:00.507586 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ea07a84e-eb3a-4430-8531-3550b9345435 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:35:00.508264 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ea07a84e-eb3a-4430-8531-3550b9345435 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:35:00.516373 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ea07a84e-eb3a-4430-8531-3550b9345435 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:35:00.516677 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ea07a84e-eb3a-4430-8531-3550b9345435 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:35:00.517534 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ea07a84e-eb3a-4430-8531-3550b9345435 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:35:00.518040 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ea07a84e-eb3a-4430-8531-3550b9345435 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:35:00.727147 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-69d4d36f-19b8-416c-bef4-7141fc0d26c0 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:35:00.727748 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-69d4d36f-19b8-416c-bef4-7141fc0d26c0 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] [instance: 900317e8-8e9d-49e0-927b-a4d30c204f2c] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:35:00.736402 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-69d4d36f-19b8-416c-bef4-7141fc0d26c0 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:35:00.736905 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-69d4d36f-19b8-416c-bef4-7141fc0d26c0 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:35:00.737753 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-69d4d36f-19b8-416c-bef4-7141fc0d26c0 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:35:00.738244 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-69d4d36f-19b8-416c-bef4-7141fc0d26c0 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:35:00.795940 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-69d4d36f-19b8-416c-bef4-7141fc0d26c0 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] HTTP exception thrown: Instance 900317e8-8e9d-49e0-927b-a4d30c204f2c could not be found. Feb 19 02:35:00.796610 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-69d4d36f-19b8-416c-bef4-7141fc0d26c0 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Returning 404 to user: Instance 900317e8-8e9d-49e0-927b-a4d30c204f2c could not be found. {{(pid=98194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:35:00.798180 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-69d4d36f-19b8-416c-bef4-7141fc0d26c0 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c" status: 404 len: 111 microversion: 2.1 time: 0.074640 Feb 19 02:35:00.799023 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 513/1036] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:35:00 2021] GET /compute/v2.1/servers/900317e8-8e9d-49e0-927b-a4d30c204f2c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 19 02:35:00.807462 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7f6323fe-f90d-4460-b27d-719877ca0c51 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '.version_select at 0x7f217d6e0730>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:35:01.070946 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7f6323fe-f90d-4460-b27d-719877ca0c51 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/2ae6ce9c-43f2-4e7d-ada0-360d5156cba4" status: 202 len: 0 microversion: 2.1 time: 0.267202 Feb 19 02:35:01.071786 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 514/1037] 10.222.0.44 () {58 vars in 1262 bytes} [Fri Feb 19 02:35:00 2021] DELETE /compute/v2.1/os-security-groups/2ae6ce9c-43f2-4e7d-ada0-360d5156cba4 => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 19 02:35:01.080478 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-34181bdd-4015-4059-a365-105fbf61a188 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] Calling method '.version_select at 0x7f217d6e0ea0>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:35:01.097897 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-34181bdd-4015-4059-a365-105fbf61a188 tempest-TestShelveInstance-2107530289 tempest-TestShelveInstance-2107530289-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-943050906" status: 202 len: 0 microversion: 2.1 time: 0.021594 Feb 19 02:35:01.098687 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 515/1038] 10.222.0.44 () {58 vars in 1241 bytes} [Fri Feb 19 02:35:01 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-943050906 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 19 02:35:01.190962 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ea07a84e-eb3a-4430-8531-3550b9345435 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:35:01.200661 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ea07a84e-eb3a-4430-8531-3550b9345435 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1553 microversion: 2.1 time: 0.697303 Feb 19 02:35:01.201379 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 524/1039] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:35:00 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1553 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:35:01.717213 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-d0ec4beb-5d42-4ed2-a420-c50bfa84cfdb req-9a7d6e25-29a7-447e-af06-a96eab90e379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec6a4f24-919b-4160-9c5f-07d6513e1e08", "name": "network-vif-unplugged", "status": "completed", "tag": "2d39a22b-39a7-4bd0-b9ae-911a223833df"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:35:01.720479 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:35:01.720479 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:35:01.731736 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-d0ec4beb-5d42-4ed2-a420-c50bfa84cfdb req-9a7d6e25-29a7-447e-af06-a96eab90e379 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:35:01.732448 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-d0ec4beb-5d42-4ed2-a420-c50bfa84cfdb req-9a7d6e25-29a7-447e-af06-a96eab90e379 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:35:01.751148 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-d0ec4beb-5d42-4ed2-a420-c50bfa84cfdb req-9a7d6e25-29a7-447e-af06-a96eab90e379 service nova] Creating event network-vif-unplugged:2d39a22b-39a7-4bd0-b9ae-911a223833df for instance ec6a4f24-919b-4160-9c5f-07d6513e1e08 on hv-cinder-77642 Feb 19 02:35:01.756744 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-d0ec4beb-5d42-4ed2-a420-c50bfa84cfdb req-9a7d6e25-29a7-447e-af06-a96eab90e379 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043421 Feb 19 02:35:01.758236 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 516/1040] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:35:01 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:35:02.220424 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8ee6acce-d8e5-4207-8654-6d5c19750bab tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:35:02.221235 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8ee6acce-d8e5-4207-8654-6d5c19750bab tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:35:02.231394 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8ee6acce-d8e5-4207-8654-6d5c19750bab tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:35:02.232008 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8ee6acce-d8e5-4207-8654-6d5c19750bab tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:35:02.232939 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8ee6acce-d8e5-4207-8654-6d5c19750bab tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:35:02.233507 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8ee6acce-d8e5-4207-8654-6d5c19750bab tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:35:02.707574 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8ee6acce-d8e5-4207-8654-6d5c19750bab tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:35:02.717811 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8ee6acce-d8e5-4207-8654-6d5c19750bab tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1553 microversion: 2.1 time: 0.501353 Feb 19 02:35:02.720200 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 525/1041] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:35:02 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1553 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:35:03.322694 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-7c325cde-0e0b-4426-b7d7-5dc2229eb8d2 req-0ac17ca5-2bb8-4953-8b9d-14ac531408e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec6a4f24-919b-4160-9c5f-07d6513e1e08", "name": "network-vif-deleted", "tag": "2d39a22b-39a7-4bd0-b9ae-911a223833df"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:35:03.324533 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:35:03.324533 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:35:03.341615 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-7c325cde-0e0b-4426-b7d7-5dc2229eb8d2 req-0ac17ca5-2bb8-4953-8b9d-14ac531408e0 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:35:03.342112 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-7c325cde-0e0b-4426-b7d7-5dc2229eb8d2 req-0ac17ca5-2bb8-4953-8b9d-14ac531408e0 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:35:03.371816 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-7c325cde-0e0b-4426-b7d7-5dc2229eb8d2 req-0ac17ca5-2bb8-4953-8b9d-14ac531408e0 service nova] Creating event network-vif-deleted:2d39a22b-39a7-4bd0-b9ae-911a223833df for instance ec6a4f24-919b-4160-9c5f-07d6513e1e08 on hv-cinder-77642 Feb 19 02:35:03.378682 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-7c325cde-0e0b-4426-b7d7-5dc2229eb8d2 req-0ac17ca5-2bb8-4953-8b9d-14ac531408e0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060292 Feb 19 02:35:03.379818 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 517/1042] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:35:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:35:03.738407 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-26a68356-a4a5-4b1c-a705-7b6ae6488b00 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:35:03.739080 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-26a68356-a4a5-4b1c-a705-7b6ae6488b00 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:35:03.747510 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-26a68356-a4a5-4b1c-a705-7b6ae6488b00 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:35:03.748030 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-26a68356-a4a5-4b1c-a705-7b6ae6488b00 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:35:03.748923 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-26a68356-a4a5-4b1c-a705-7b6ae6488b00 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:35:03.749488 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-26a68356-a4a5-4b1c-a705-7b6ae6488b00 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:35:03.830170 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-26a68356-a4a5-4b1c-a705-7b6ae6488b00 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:35:03.830944 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-26a68356-a4a5-4b1c-a705-7b6ae6488b00 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:35:03.831673 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.objects.instance [None req-26a68356-a4a5-4b1c-a705-7b6ae6488b00 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lazy-loading 'fault' on Instance uuid ec6a4f24-919b-4160-9c5f-07d6513e1e08 {{(pid=98193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 02:35:03.916604 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-26a68356-a4a5-4b1c-a705-7b6ae6488b00 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb2590036de478895f2fae1592cdd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed76decd92fc4f23bf841fd8f151e05c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:35:03.927277 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-26a68356-a4a5-4b1c-a705-7b6ae6488b00 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 200 len: 1348 microversion: 2.1 time: 0.193659 Feb 19 02:35:03.928534 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 526/1043] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:35:03 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 1348 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:35:04.948251 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ab092894-4b2f-4fd1-bc8d-8c251f0f9702 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:35:04.949952 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ab092894-4b2f-4fd1-bc8d-8c251f0f9702 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] [instance: ec6a4f24-919b-4160-9c5f-07d6513e1e08] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:35:04.967572 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ab092894-4b2f-4fd1-bc8d-8c251f0f9702 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:35:04.971226 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ab092894-4b2f-4fd1-bc8d-8c251f0f9702 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:35:04.975312 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ab092894-4b2f-4fd1-bc8d-8c251f0f9702 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:35:04.976240 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ab092894-4b2f-4fd1-bc8d-8c251f0f9702 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:35:05.059758 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-ab092894-4b2f-4fd1-bc8d-8c251f0f9702 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] HTTP exception thrown: Instance ec6a4f24-919b-4160-9c5f-07d6513e1e08 could not be found. Feb 19 02:35:05.061590 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ab092894-4b2f-4fd1-bc8d-8c251f0f9702 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Returning 404 to user: Instance ec6a4f24-919b-4160-9c5f-07d6513e1e08 could not be found. {{(pid=98194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:35:05.063840 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ab092894-4b2f-4fd1-bc8d-8c251f0f9702 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08" status: 404 len: 111 microversion: 2.1 time: 0.120256 Feb 19 02:35:05.064998 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 518/1044] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:35:04 2021] GET /compute/v2.1/servers/ec6a4f24-919b-4160-9c5f-07d6513e1e08 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 02:35:05.074491 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7f0e838d-dc80-4d6d-b03a-3eb9e60e4dc3 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] Calling method '.version_select at 0x7f217c2f2a60>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:35:05.101798 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7f0e838d-dc80-4d6d-b03a-3eb9e60e4dc3 tempest-TestMinimumBasicScenario-946864721 tempest-TestMinimumBasicScenario-946864721-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1114315365" status: 202 len: 0 microversion: 2.1 time: 0.032153 Feb 19 02:35:05.102465 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 527/1045] 10.222.0.44 () {58 vars in 1262 bytes} [Fri Feb 19 02:35:05 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1114315365 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:35:33.445859 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-047c6f69-3638-4913-a4bd-e602c8dc6f8a tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Action: 'create', calling method: .version_select at 0x7f217d6e09d8>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-483956370"}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:35:33.470276 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-047c6f69-3638-4913-a4bd-e602c8dc6f8a tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Getting quotas for project 3b0847ee05c643e981b009b8bc77c1aa. Resources: {'key_pairs'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:35:33.474515 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-047c6f69-3638-4913-a4bd-e602c8dc6f8a tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Getting quotas for user 4372723bc6674cb4972c619b77ae55db and project 3b0847ee05c643e981b009b8bc77c1aa. Resources: {'key_pairs'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:35:33.554158 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-047c6f69-3638-4913-a4bd-e602c8dc6f8a tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Getting quotas for project 3b0847ee05c643e981b009b8bc77c1aa. Resources: {'key_pairs'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:35:33.558168 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-047c6f69-3638-4913-a4bd-e602c8dc6f8a tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Getting quotas for user 4372723bc6674cb4972c619b77ae55db and project 3b0847ee05c643e981b009b8bc77c1aa. Resources: {'key_pairs'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:35:33.572162 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-047c6f69-3638-4913-a4bd-e602c8dc6f8a tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.315855 Feb 19 02:35:33.572761 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 519/1046] 10.222.0.44 () {60 vars in 1148 bytes} [Fri Feb 19 02:35:33 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:35:33.583856 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e95a2c3d-af1b-465d-af8f-8ae6753ef504 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Action: 'create', calling method: .version_select at 0x7f217c2f2268>, body: {"security_group": {"name": "tempest-TestVolumeBootPattern-89846141", "description": "tempest-TestVolumeBootPattern-89846141 description"}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:35:33.791697 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e95a2c3d-af1b-465d-af8f-8ae6753ef504 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.211951 Feb 19 02:35:33.792417 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 528/1047] 10.222.0.44 () {60 vars in 1170 bytes} [Fri Feb 19 02:35:33 2021] POST /compute/v2.1/os-security-groups => generated 247 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:35:33.804594 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-de402806-1ac3-421a-b285-cb73c629db70 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Action: 'create', calling method: .version_select at 0x7f217d6e02f0>, body: {"security_group_rule": {"parent_group_id": "622b6944-4cf6-4d6d-99db-d5660c7b5ae1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "0.0.0.0/0"}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:35:34.021673 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-de402806-1ac3-421a-b285-cb73c629db70 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.220966 Feb 19 02:35:34.022346 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 520/1048] 10.222.0.44 () {60 vars in 1185 bytes} [Fri Feb 19 02:35:33 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:35:34.033853 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-234298e0-2536-48db-98e1-8defb07d97ba tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Action: 'create', calling method: .version_select at 0x7f217c4e9400>, body: {"security_group_rule": {"parent_group_id": "622b6944-4cf6-4d6d-99db-d5660c7b5ae1", "ip_protocol": "icmp", "from_port": -1, "to_port": -1, "cidr": "0.0.0.0/0"}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:35:34.262410 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-234298e0-2536-48db-98e1-8defb07d97ba tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.232917 Feb 19 02:35:34.263137 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 529/1049] 10.222.0.44 () {60 vars in 1185 bytes} [Fri Feb 19 02:35:34 2021] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:35:50.454834 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e1ede57c-6020-4f32-861b-76b1d02df8d5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1966650032", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-483956370", "security_groups": [{"name": "tempest-TestVolumeBootPattern-89846141"}], "block_device_mapping_v2": [{"uuid": "c03a4866-2222-4df3-a043-bfecda8e2768", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d7a3d9c7-d762-4eea-968f-4f012d4c747a"}]}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:35:50.638734 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-e1ede57c-6020-4f32-861b-76b1d02df8d5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] validate_networks() for [('d7a3d9c7-d762-4eea-968f-4f012d4c747a', None, None, None)] {{(pid=98194) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 02:35:51.465403 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-e1ede57c-6020-4f32-861b-76b1d02df8d5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Flavor limits 0:0:0 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 02:35:51.465886 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-e1ede57c-6020-4f32-861b-76b1d02df8d5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Image limits 0:0:0 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 02:35:51.466400 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-e1ede57c-6020-4f32-861b-76b1d02df8d5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Flavor pref 0:0:0 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 02:35:51.466861 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-e1ede57c-6020-4f32-861b-76b1d02df8d5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Image pref 0:0:0 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 02:35:51.467314 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-e1ede57c-6020-4f32-861b-76b1d02df8d5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98194) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 02:35:51.476323 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e1ede57c-6020-4f32-861b-76b1d02df8d5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:35:51.476917 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e1ede57c-6020-4f32-861b-76b1d02df8d5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:35:51.477830 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e1ede57c-6020-4f32-861b-76b1d02df8d5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:35:51.478317 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e1ede57c-6020-4f32-861b-76b1d02df8d5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:35:51.496871 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-e1ede57c-6020-4f32-861b-76b1d02df8d5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Getting quotas for project 3b0847ee05c643e981b009b8bc77c1aa. Resources: {'ram', 'instances', 'cores'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:35:51.501723 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-e1ede57c-6020-4f32-861b-76b1d02df8d5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Getting quotas for user 4372723bc6674cb4972c619b77ae55db and project 3b0847ee05c643e981b009b8bc77c1aa. Resources: {'ram', 'instances', 'cores'} {{(pid=98194) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:35:51.604807 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e1ede57c-6020-4f32-861b-76b1d02df8d5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Going to run 1 instances... {{(pid=98194) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 02:35:51.607213 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e1ede57c-6020-4f32-861b-76b1d02df8d5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c03a4866-2222-4df3-a043-bfecda8e2768',volume_size=None,volume_type=None)] {{(pid=98194) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 02:35:51.782022 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e1ede57c-6020-4f32-861b-76b1d02df8d5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [1721e70a-b486-4171-9642-fb992611d5dd] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 19 02:35:52.799775 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO oslo.messaging._drivers.impl_rabbit [None req-e1ede57c-6020-4f32-861b-76b1d02df8d5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [1721e70a-b486-4171-9642-fb992611d5dd] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 54072. Feb 19 02:35:52.805362 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e1ede57c-6020-4f32-861b-76b1d02df8d5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 411 microversion: 2.1 time: 2.355135 Feb 19 02:35:52.811212 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 521/1050] 10.222.0.44 () {60 vars in 1137 bytes} [Fri Feb 19 02:35:50 2021] POST /compute/v2.1/servers => generated 411 bytes in 2357 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 02:35:52.819202 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1a5f2997-1056-4510-8988-a47a2c9d292e tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:35:52.819852 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1a5f2997-1056-4510-8988-a47a2c9d292e tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:35:52.928316 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-1a5f2997-1056-4510-8988-a47a2c9d292e tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:35:52.937468 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1a5f2997-1056-4510-8988-a47a2c9d292e tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3" status: 200 len: 1094 microversion: 2.1 time: 0.121658 Feb 19 02:35:52.938142 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 530/1051] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:35:52 2021] GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3 => generated 1094 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:35:53.956484 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ceb3a2d5-99ed-4d7b-bb1b-585a9def40e5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:35:53.957433 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ceb3a2d5-99ed-4d7b-bb1b-585a9def40e5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:35:53.967558 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ceb3a2d5-99ed-4d7b-bb1b-585a9def40e5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:35:53.968691 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ceb3a2d5-99ed-4d7b-bb1b-585a9def40e5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:35:53.969617 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ceb3a2d5-99ed-4d7b-bb1b-585a9def40e5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:35:53.970188 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ceb3a2d5-99ed-4d7b-bb1b-585a9def40e5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:35:54.099916 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ceb3a2d5-99ed-4d7b-bb1b-585a9def40e5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:35:54.111050 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ceb3a2d5-99ed-4d7b-bb1b-585a9def40e5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3" status: 200 len: 1210 microversion: 2.1 time: 0.159447 Feb 19 02:35:54.111867 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 522/1052] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:35:53 2021] GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3 => generated 1210 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:35:55.130049 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-49087b2b-8a86-472a-b1b7-01532e8f75c5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:35:55.130776 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-49087b2b-8a86-472a-b1b7-01532e8f75c5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:35:55.139366 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-49087b2b-8a86-472a-b1b7-01532e8f75c5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:35:55.140138 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-49087b2b-8a86-472a-b1b7-01532e8f75c5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:35:55.141166 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-49087b2b-8a86-472a-b1b7-01532e8f75c5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:35:55.141930 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-49087b2b-8a86-472a-b1b7-01532e8f75c5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:35:55.646542 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-49087b2b-8a86-472a-b1b7-01532e8f75c5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:35:55.655352 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-49087b2b-8a86-472a-b1b7-01532e8f75c5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3" status: 200 len: 1271 microversion: 2.1 time: 0.529441 Feb 19 02:35:55.656186 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 531/1053] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:35:55 2021] GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3 => generated 1271 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:35:56.673772 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4607e899-58fb-46ed-b0ca-42039ef4a126 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:35:56.674474 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-4607e899-58fb-46ed-b0ca-42039ef4a126 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:35:56.682274 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4607e899-58fb-46ed-b0ca-42039ef4a126 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:35:56.682815 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4607e899-58fb-46ed-b0ca-42039ef4a126 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:35:56.683650 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4607e899-58fb-46ed-b0ca-42039ef4a126 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:35:56.684139 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4607e899-58fb-46ed-b0ca-42039ef4a126 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:35:56.716160 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-43075490-6133-4c18-9a2b-d91d0366a164 req-6297b1e5-ffa0-44d9-a428-01a83bd5d8a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3", "tag": "1c4bf552-dec7-46b1-9380-540b25abd4a1"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:35:56.720708 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:35:56.720708 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:35:56.735563 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-43075490-6133-4c18-9a2b-d91d0366a164 req-6297b1e5-ffa0-44d9-a428-01a83bd5d8a1 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:35:56.736062 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-43075490-6133-4c18-9a2b-d91d0366a164 req-6297b1e5-ffa0-44d9-a428-01a83bd5d8a1 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:35:56.758800 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-43075490-6133-4c18-9a2b-d91d0366a164 req-6297b1e5-ffa0-44d9-a428-01a83bd5d8a1 service nova] Creating event network-changed:1c4bf552-dec7-46b1-9380-540b25abd4a1 for instance b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3 on hv-cinder-77642 Feb 19 02:35:56.764458 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-43075490-6133-4c18-9a2b-d91d0366a164 req-6297b1e5-ffa0-44d9-a428-01a83bd5d8a1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052474 Feb 19 02:35:56.765317 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 532/1054] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:35:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:35:56.928555 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-4607e899-58fb-46ed-b0ca-42039ef4a126 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:35:56.945399 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-4607e899-58fb-46ed-b0ca-42039ef4a126 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3" status: 200 len: 1271 microversion: 2.1 time: 0.275865 Feb 19 02:35:56.946692 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 523/1055] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:35:56 2021] GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3 => generated 1271 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:35:57.964790 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1cf6df04-6898-4415-a695-1616a25978d8 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:35:57.965561 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-1cf6df04-6898-4415-a695-1616a25978d8 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:35:57.975407 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1cf6df04-6898-4415-a695-1616a25978d8 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:35:57.975918 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1cf6df04-6898-4415-a695-1616a25978d8 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:35:57.976804 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1cf6df04-6898-4415-a695-1616a25978d8 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:35:57.977298 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-1cf6df04-6898-4415-a695-1616a25978d8 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:35:58.292301 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-1cf6df04-6898-4415-a695-1616a25978d8 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:35:58.301940 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1cf6df04-6898-4415-a695-1616a25978d8 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3" status: 200 len: 1271 microversion: 2.1 time: 0.341746 Feb 19 02:35:58.302594 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 533/1056] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:35:57 2021] GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3 => generated 1271 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:35:59.320791 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-daf7b402-13e9-4eea-afc2-22f60ef238fa tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:35:59.321356 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-daf7b402-13e9-4eea-afc2-22f60ef238fa tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:35:59.330141 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-daf7b402-13e9-4eea-afc2-22f60ef238fa tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:35:59.330700 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-daf7b402-13e9-4eea-afc2-22f60ef238fa tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:35:59.331530 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-daf7b402-13e9-4eea-afc2-22f60ef238fa tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:35:59.332025 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-daf7b402-13e9-4eea-afc2-22f60ef238fa tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:35:59.542206 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-daf7b402-13e9-4eea-afc2-22f60ef238fa tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:35:59.551670 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-daf7b402-13e9-4eea-afc2-22f60ef238fa tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3" status: 200 len: 1271 microversion: 2.1 time: 0.235037 Feb 19 02:35:59.552292 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 524/1057] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:35:59 2021] GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3 => generated 1271 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:36:00.570139 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-27f870f0-cabb-427c-b40e-c7cb114d8c98 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:36:00.570837 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-27f870f0-cabb-427c-b40e-c7cb114d8c98 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:36:00.579804 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-27f870f0-cabb-427c-b40e-c7cb114d8c98 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:36:00.580309 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-27f870f0-cabb-427c-b40e-c7cb114d8c98 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:36:00.581146 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-27f870f0-cabb-427c-b40e-c7cb114d8c98 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:36:00.581634 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-27f870f0-cabb-427c-b40e-c7cb114d8c98 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:36:00.789432 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-27f870f0-cabb-427c-b40e-c7cb114d8c98 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:36:00.799070 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-27f870f0-cabb-427c-b40e-c7cb114d8c98 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3" status: 200 len: 1271 microversion: 2.1 time: 0.232813 Feb 19 02:36:00.799684 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 534/1058] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:36:00 2021] GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3 => generated 1271 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:36:01.817065 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d97097a2-8794-4e8a-be2d-0caa12298c05 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:36:01.817725 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d97097a2-8794-4e8a-be2d-0caa12298c05 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:36:01.825467 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d97097a2-8794-4e8a-be2d-0caa12298c05 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:36:01.825971 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d97097a2-8794-4e8a-be2d-0caa12298c05 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:36:01.827332 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d97097a2-8794-4e8a-be2d-0caa12298c05 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:36:01.827832 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d97097a2-8794-4e8a-be2d-0caa12298c05 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:36:02.039506 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-d97097a2-8794-4e8a-be2d-0caa12298c05 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:36:02.048750 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d97097a2-8794-4e8a-be2d-0caa12298c05 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3" status: 200 len: 1271 microversion: 2.1 time: 0.235799 Feb 19 02:36:02.049462 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 525/1059] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:36:01 2021] GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3 => generated 1271 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:36:03.067514 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-61a64e8b-e05b-497b-a3c6-02693d8afcba tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:36:03.068175 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-61a64e8b-e05b-497b-a3c6-02693d8afcba tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:36:03.076000 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-61a64e8b-e05b-497b-a3c6-02693d8afcba tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:36:03.076507 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-61a64e8b-e05b-497b-a3c6-02693d8afcba tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:36:03.077896 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-61a64e8b-e05b-497b-a3c6-02693d8afcba tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:36:03.078664 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-61a64e8b-e05b-497b-a3c6-02693d8afcba tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:36:03.398703 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-61a64e8b-e05b-497b-a3c6-02693d8afcba tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:36:03.408218 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-61a64e8b-e05b-497b-a3c6-02693d8afcba tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3" status: 200 len: 1271 microversion: 2.1 time: 0.344651 Feb 19 02:36:03.408791 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 535/1060] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:36:03 2021] GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3 => generated 1271 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:36:04.168933 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-3030c93c-cd92-47df-823a-9a40271df994 req-2befe29e-d542-45ae-a7df-ee7aa7bd5329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3", "name": "network-vif-plugged", "status": "completed", "tag": "1c4bf552-dec7-46b1-9380-540b25abd4a1"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:36:04.171371 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:36:04.171371 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:36:04.181257 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-3030c93c-cd92-47df-823a-9a40271df994 req-2befe29e-d542-45ae-a7df-ee7aa7bd5329 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:36:04.181750 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-3030c93c-cd92-47df-823a-9a40271df994 req-2befe29e-d542-45ae-a7df-ee7aa7bd5329 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:36:04.199554 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-3030c93c-cd92-47df-823a-9a40271df994 req-2befe29e-d542-45ae-a7df-ee7aa7bd5329 service nova] Creating event network-vif-plugged:1c4bf552-dec7-46b1-9380-540b25abd4a1 for instance b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3 on hv-cinder-77642 Feb 19 02:36:04.204911 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-3030c93c-cd92-47df-823a-9a40271df994 req-2befe29e-d542-45ae-a7df-ee7aa7bd5329 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040216 Feb 19 02:36:04.205799 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 526/1061] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:36:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:36:04.426914 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4c4fb777-800d-451e-a79d-6dee0acf791a tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:36:04.427528 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-4c4fb777-800d-451e-a79d-6dee0acf791a tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:36:04.435324 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4c4fb777-800d-451e-a79d-6dee0acf791a tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:36:04.435836 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4c4fb777-800d-451e-a79d-6dee0acf791a tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:36:04.436667 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4c4fb777-800d-451e-a79d-6dee0acf791a tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:36:04.437153 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4c4fb777-800d-451e-a79d-6dee0acf791a tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:36:04.784719 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-4c4fb777-800d-451e-a79d-6dee0acf791a tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:36:04.794542 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-4c4fb777-800d-451e-a79d-6dee0acf791a tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3" status: 200 len: 1271 microversion: 2.1 time: 0.372438 Feb 19 02:36:04.795209 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 536/1062] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:36:04 2021] GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3 => generated 1271 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:36:05.814806 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5d34514c-b894-470c-8754-2816f92354b2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:36:05.815588 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5d34514c-b894-470c-8754-2816f92354b2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:36:05.824143 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5d34514c-b894-470c-8754-2816f92354b2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:36:05.824645 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5d34514c-b894-470c-8754-2816f92354b2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:36:05.825489 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5d34514c-b894-470c-8754-2816f92354b2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:36:05.825974 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5d34514c-b894-470c-8754-2816f92354b2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:36:06.099004 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-5d34514c-b894-470c-8754-2816f92354b2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:36:06.107841 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5d34514c-b894-470c-8754-2816f92354b2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3" status: 200 len: 1458 microversion: 2.1 time: 0.298576 Feb 19 02:36:06.108513 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 527/1063] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:36:05 2021] GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3 => generated 1458 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:36:06.125486 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-9bc8227f-3dd3-488a-845a-a76f4e8f5527 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:36:06.126159 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-9bc8227f-3dd3-488a-845a-a76f4e8f5527 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:36:06.133920 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9bc8227f-3dd3-488a-845a-a76f4e8f5527 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:36:06.134482 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9bc8227f-3dd3-488a-845a-a76f4e8f5527 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:36:06.135296 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9bc8227f-3dd3-488a-845a-a76f4e8f5527 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:36:06.135788 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9bc8227f-3dd3-488a-845a-a76f4e8f5527 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:36:06.341086 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9bc8227f-3dd3-488a-845a-a76f4e8f5527 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:36:06.350494 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-9bc8227f-3dd3-488a-845a-a76f4e8f5527 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3" status: 200 len: 1458 microversion: 2.1 time: 0.229481 Feb 19 02:36:06.351111 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 537/1064] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:36:06 2021] GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3 => generated 1458 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:36:06.367968 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7286f330-6032-408b-81af-859a95a95780 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Action: 'create', calling method: .version_select at 0x7f217c172840>, body: {"pool": null} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:36:08.416658 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7286f330-6032-408b-81af-859a95a95780 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.052508 Feb 19 02:36:08.417322 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 528/1065] 10.222.0.44 () {60 vars in 1160 bytes} [Fri Feb 19 02:36:06 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2054 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:36:08.429568 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-bc92eef1-ce76-4e7c-a2ad-19fb7c24866f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.1.13"}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:36:08.430793 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-bc92eef1-ce76-4e7c-a2ad-19fb7c24866f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:36:08.442056 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bc92eef1-ce76-4e7c-a2ad-19fb7c24866f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:36:08.442615 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bc92eef1-ce76-4e7c-a2ad-19fb7c24866f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:36:08.443455 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bc92eef1-ce76-4e7c-a2ad-19fb7c24866f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:36:08.443941 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bc92eef1-ce76-4e7c-a2ad-19fb7c24866f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:36:08.516538 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bc92eef1-ce76-4e7c-a2ad-19fb7c24866f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Acquired lock "refresh_cache-b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3" {{(pid=98193) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 19 02:36:10.481620 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-bc92eef1-ce76-4e7c-a2ad-19fb7c24866f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3] Building network info cache for instance {{(pid=98193) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 19 02:36:10.491442 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-8839f2bc-5908-4d04-80f2-6eb67d5ad8d3 req-dd2739ce-506b-4512-bf3c-143d0be81ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3", "tag": "1c4bf552-dec7-46b1-9380-540b25abd4a1"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:36:10.493286 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:36:10.493286 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:36:10.503192 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-8839f2bc-5908-4d04-80f2-6eb67d5ad8d3 req-dd2739ce-506b-4512-bf3c-143d0be81ed4 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:36:10.503777 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-8839f2bc-5908-4d04-80f2-6eb67d5ad8d3 req-dd2739ce-506b-4512-bf3c-143d0be81ed4 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:36:10.521298 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-8839f2bc-5908-4d04-80f2-6eb67d5ad8d3 req-dd2739ce-506b-4512-bf3c-143d0be81ed4 service nova] Creating event network-changed:1c4bf552-dec7-46b1-9380-540b25abd4a1 for instance b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3 on hv-cinder-77642 Feb 19 02:36:10.526560 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-8839f2bc-5908-4d04-80f2-6eb67d5ad8d3 req-dd2739ce-506b-4512-bf3c-143d0be81ed4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038893 Feb 19 02:36:10.527534 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 529/1066] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:36:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:36:11.955627 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-bc92eef1-ce76-4e7c-a2ad-19fb7c24866f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3] Updating instance_info_cache with network_info: [{"id": "1c4bf552-dec7-46b1-9380-540b25abd4a1", "address": "fa:16:3e:1a:f4:ea", "network": {"id": "d7a3d9c7-d762-4eea-968f-4f012d4c747a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1263351507-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.1.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3b0847ee05c643e981b009b8bc77c1aa", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap1c4bf552-de", "ovs_interfaceid": "1c4bf552-dec7-46b1-9380-540b25abd4a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98193) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 19 02:36:11.967477 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-bc92eef1-ce76-4e7c-a2ad-19fb7c24866f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Releasing lock "refresh_cache-b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3" {{(pid=98193) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 19 02:36:11.968508 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-bc92eef1-ce76-4e7c-a2ad-19fb7c24866f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "POST /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3/action" status: 202 len: 0 microversion: 2.1 time: 3.543095 Feb 19 02:36:11.969243 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 538/1067] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:36:08 2021] POST /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3/action => generated 0 bytes in 3544 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 19 02:37:50.254446 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 02:37:50.255002 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: Fri Feb 19 02:37:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 02:38:00.585229 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5dba8a59-5308-4e7a-8153-761a088858d6 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:38:00.585851 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5dba8a59-5308-4e7a-8153-761a088858d6 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:38:00.589456 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: ERROR oslo.messaging._drivers.impl_rabbit [-] [404af4ea-fd5e-424a-8ccf-345b909fc274] AMQP server on 10.222.0.44:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 19 02:38:00.595680 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5dba8a59-5308-4e7a-8153-761a088858d6 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:00.596181 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5dba8a59-5308-4e7a-8153-761a088858d6 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:00.597006 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5dba8a59-5308-4e7a-8153-761a088858d6 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:00.597489 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5dba8a59-5308-4e7a-8153-761a088858d6 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:00.669391 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5dba8a59-5308-4e7a-8153-761a088858d6 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3] Going to try to terminate instance {{(pid=98194) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 02:38:00.783727 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5dba8a59-5308-4e7a-8153-761a088858d6 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3" status: 204 len: 0 microversion: 2.1 time: 0.202727 Feb 19 02:38:00.784354 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 530/1068] 10.222.0.44 () {58 vars in 1229 bytes} [Fri Feb 19 02:38:00 2021] DELETE /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 02:38:00.793064 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-3cbd127a-6ad0-40bf-8fef-e8406db8b9be tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:38:00.793494 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-3cbd127a-6ad0-40bf-8fef-e8406db8b9be tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:38:00.797065 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ae901456-ab94-4419-90d8-7d9b28435724] AMQP server on 10.222.0.44:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 19 02:38:00.803187 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3cbd127a-6ad0-40bf-8fef-e8406db8b9be tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:00.803688 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3cbd127a-6ad0-40bf-8fef-e8406db8b9be tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:00.804516 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3cbd127a-6ad0-40bf-8fef-e8406db8b9be tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:00.805003 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3cbd127a-6ad0-40bf-8fef-e8406db8b9be tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:01.016682 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-3cbd127a-6ad0-40bf-8fef-e8406db8b9be tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:38:01.025414 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-3cbd127a-6ad0-40bf-8fef-e8406db8b9be tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3" status: 200 len: 1582 microversion: 2.1 time: 0.236489 Feb 19 02:38:01.026021 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 539/1069] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:38:00 2021] GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3 => generated 1582 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:38:02.044740 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-98890a01-2fee-478f-8d45-432e10898bcb tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:38:02.045523 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-98890a01-2fee-478f-8d45-432e10898bcb tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:38:02.065226 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-98890a01-2fee-478f-8d45-432e10898bcb tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:02.065738 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-98890a01-2fee-478f-8d45-432e10898bcb tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:02.066610 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-98890a01-2fee-478f-8d45-432e10898bcb tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:02.067104 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-98890a01-2fee-478f-8d45-432e10898bcb tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:02.103080 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO oslo.messaging._drivers.impl_rabbit [-] [404af4ea-fd5e-424a-8ccf-345b909fc274] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 54158. Feb 19 02:38:02.289501 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-98890a01-2fee-478f-8d45-432e10898bcb tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:38:02.299166 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-98890a01-2fee-478f-8d45-432e10898bcb tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3" status: 200 len: 1582 microversion: 2.1 time: 0.259037 Feb 19 02:38:02.299787 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 531/1070] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:38:02 2021] GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3 => generated 1582 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:38:03.317940 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-80f22493-0abd-433b-b789-59c836fb0a5f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:38:03.318630 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-80f22493-0abd-433b-b789-59c836fb0a5f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:38:03.337366 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-80f22493-0abd-433b-b789-59c836fb0a5f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:03.337874 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-80f22493-0abd-433b-b789-59c836fb0a5f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:03.338734 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-80f22493-0abd-433b-b789-59c836fb0a5f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:03.339221 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-80f22493-0abd-433b-b789-59c836fb0a5f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:03.400487 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO oslo.messaging._drivers.impl_rabbit [-] [ae901456-ab94-4419-90d8-7d9b28435724] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 54162. Feb 19 02:38:03.501147 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-80f22493-0abd-433b-b789-59c836fb0a5f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:38:03.509985 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-80f22493-0abd-433b-b789-59c836fb0a5f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3" status: 200 len: 1509 microversion: 2.1 time: 0.196680 Feb 19 02:38:03.510655 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 540/1071] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:38:03 2021] GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3 => generated 1509 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:38:03.855745 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-b542c50e-16ea-4ab8-a6e9-7d66fa5ff0d2 req-67caffba-af20-4157-910f-3c21c7f588f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3", "name": "network-vif-deleted", "tag": "1c4bf552-dec7-46b1-9380-540b25abd4a1"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:38:03.857514 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:38:03.857514 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:38:03.867353 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-b542c50e-16ea-4ab8-a6e9-7d66fa5ff0d2 req-67caffba-af20-4157-910f-3c21c7f588f1 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:03.868105 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-b542c50e-16ea-4ab8-a6e9-7d66fa5ff0d2 req-67caffba-af20-4157-910f-3c21c7f588f1 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:03.888477 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-b542c50e-16ea-4ab8-a6e9-7d66fa5ff0d2 req-67caffba-af20-4157-910f-3c21c7f588f1 service nova] Creating event network-vif-deleted:1c4bf552-dec7-46b1-9380-540b25abd4a1 for instance b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3 on hv-cinder-77642 Feb 19 02:38:03.894179 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-b542c50e-16ea-4ab8-a6e9-7d66fa5ff0d2 req-67caffba-af20-4157-910f-3c21c7f588f1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044763 Feb 19 02:38:03.894890 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 532/1072] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:38:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:38:04.527351 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-492cbfbd-f9f0-4586-9410-f73d64d60269 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:38:04.528014 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-492cbfbd-f9f0-4586-9410-f73d64d60269 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:38:04.535846 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-492cbfbd-f9f0-4586-9410-f73d64d60269 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:04.536355 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-492cbfbd-f9f0-4586-9410-f73d64d60269 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:04.537189 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-492cbfbd-f9f0-4586-9410-f73d64d60269 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:04.537682 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-492cbfbd-f9f0-4586-9410-f73d64d60269 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:04.616922 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-492cbfbd-f9f0-4586-9410-f73d64d60269 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:04.617433 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-492cbfbd-f9f0-4586-9410-f73d64d60269 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:04.618003 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.objects.instance [None req-492cbfbd-f9f0-4586-9410-f73d64d60269 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lazy-loading 'fault' on Instance uuid b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3 {{(pid=98193) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 02:38:04.944018 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-492cbfbd-f9f0-4586-9410-f73d64d60269 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:38:04.952517 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-492cbfbd-f9f0-4586-9410-f73d64d60269 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3" status: 200 len: 1184 microversion: 2.1 time: 0.429116 Feb 19 02:38:04.953454 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 541/1073] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:38:04 2021] GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3 => generated 1184 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:38:05.971593 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-16b192a3-9d9c-46b5-928d-baba129682a3 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:38:05.972361 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-16b192a3-9d9c-46b5-928d-baba129682a3 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:38:05.980522 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-16b192a3-9d9c-46b5-928d-baba129682a3 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:05.981024 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-16b192a3-9d9c-46b5-928d-baba129682a3 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:05.981845 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-16b192a3-9d9c-46b5-928d-baba129682a3 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:05.982329 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-16b192a3-9d9c-46b5-928d-baba129682a3 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:06.037579 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-16b192a3-9d9c-46b5-928d-baba129682a3 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] HTTP exception thrown: Instance b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3 could not be found. Feb 19 02:38:06.038224 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-16b192a3-9d9c-46b5-928d-baba129682a3 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Returning 404 to user: Instance b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3 could not be found. {{(pid=98194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:38:06.039135 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-16b192a3-9d9c-46b5-928d-baba129682a3 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3" status: 404 len: 111 microversion: 2.1 time: 0.072284 Feb 19 02:38:06.039723 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 533/1074] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:38:05 2021] GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 02:38:06.122449 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a27f9b31-90ec-4b7c-8f30-b9e4c96235f2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-789583092", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-483956370", "security_groups": [{"name": "tempest-TestVolumeBootPattern-89846141"}], "block_device_mapping_v2": [{"uuid": "c03a4866-2222-4df3-a043-bfecda8e2768", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d7a3d9c7-d762-4eea-968f-4f012d4c747a"}]}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:38:06.288646 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-a27f9b31-90ec-4b7c-8f30-b9e4c96235f2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] validate_networks() for [('d7a3d9c7-d762-4eea-968f-4f012d4c747a', None, None, None)] {{(pid=98193) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 02:38:06.959517 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-a27f9b31-90ec-4b7c-8f30-b9e4c96235f2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Flavor limits 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 02:38:06.959995 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-a27f9b31-90ec-4b7c-8f30-b9e4c96235f2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Image limits 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 02:38:06.960566 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-a27f9b31-90ec-4b7c-8f30-b9e4c96235f2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Flavor pref 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 02:38:06.961031 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-a27f9b31-90ec-4b7c-8f30-b9e4c96235f2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Image pref 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 02:38:06.961493 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-a27f9b31-90ec-4b7c-8f30-b9e4c96235f2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 02:38:06.971071 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a27f9b31-90ec-4b7c-8f30-b9e4c96235f2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:06.971580 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a27f9b31-90ec-4b7c-8f30-b9e4c96235f2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:06.972457 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a27f9b31-90ec-4b7c-8f30-b9e4c96235f2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:06.972953 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a27f9b31-90ec-4b7c-8f30-b9e4c96235f2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:06.991166 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-a27f9b31-90ec-4b7c-8f30-b9e4c96235f2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Getting quotas for project 3b0847ee05c643e981b009b8bc77c1aa. Resources: {'ram', 'instances', 'cores'} {{(pid=98193) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:38:06.996559 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-a27f9b31-90ec-4b7c-8f30-b9e4c96235f2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Getting quotas for user 4372723bc6674cb4972c619b77ae55db and project 3b0847ee05c643e981b009b8bc77c1aa. Resources: {'ram', 'instances', 'cores'} {{(pid=98193) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:38:07.101640 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a27f9b31-90ec-4b7c-8f30-b9e4c96235f2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Going to run 1 instances... {{(pid=98193) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 02:38:07.104070 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a27f9b31-90ec-4b7c-8f30-b9e4c96235f2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: d1cba672-d813-45f4-ab87-e7ef1ce803e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c03a4866-2222-4df3-a043-bfecda8e2768',volume_size=None,volume_type=None)] {{(pid=98193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 02:38:07.277160 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a27f9b31-90ec-4b7c-8f30-b9e4c96235f2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 411 microversion: 2.1 time: 1.158660 Feb 19 02:38:07.277858 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 542/1075] 10.222.0.44 () {60 vars in 1137 bytes} [Fri Feb 19 02:38:06 2021] POST /compute/v2.1/servers => generated 411 bytes in 1160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 02:38:07.289185 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f84b52c4-5dbf-4a4e-b463-d1660cbed1d8 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:38:07.291225 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f84b52c4-5dbf-4a4e-b463-d1660cbed1d8 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: d1cba672-d813-45f4-ab87-e7ef1ce803e4] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:38:07.373978 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-f84b52c4-5dbf-4a4e-b463-d1660cbed1d8 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:38:07.382082 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f84b52c4-5dbf-4a4e-b463-d1660cbed1d8 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4" status: 200 len: 1093 microversion: 2.1 time: 0.096995 Feb 19 02:38:07.382880 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 534/1076] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:38:07 2021] GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4 => generated 1093 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:38:08.400690 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-63b373db-10c9-4bee-bd0c-e31566513aa2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:38:08.401363 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-63b373db-10c9-4bee-bd0c-e31566513aa2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: d1cba672-d813-45f4-ab87-e7ef1ce803e4] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:38:08.410654 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-63b373db-10c9-4bee-bd0c-e31566513aa2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:08.411166 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-63b373db-10c9-4bee-bd0c-e31566513aa2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:08.412015 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-63b373db-10c9-4bee-bd0c-e31566513aa2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:08.412514 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-63b373db-10c9-4bee-bd0c-e31566513aa2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:08.576761 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-63b373db-10c9-4bee-bd0c-e31566513aa2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:38:08.586442 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-63b373db-10c9-4bee-bd0c-e31566513aa2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4" status: 200 len: 1199 microversion: 2.1 time: 0.189869 Feb 19 02:38:08.587272 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 543/1077] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:38:08 2021] GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4 => generated 1199 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:38:09.606092 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-a03d896c-9d36-42e0-9b1a-10bbb1ed884c tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:38:09.606578 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-a03d896c-9d36-42e0-9b1a-10bbb1ed884c tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: d1cba672-d813-45f4-ab87-e7ef1ce803e4] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:38:09.616146 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a03d896c-9d36-42e0-9b1a-10bbb1ed884c tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:09.616808 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a03d896c-9d36-42e0-9b1a-10bbb1ed884c tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:09.617671 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a03d896c-9d36-42e0-9b1a-10bbb1ed884c tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:09.618171 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-a03d896c-9d36-42e0-9b1a-10bbb1ed884c tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:09.835554 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-a03d896c-9d36-42e0-9b1a-10bbb1ed884c tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:38:09.845382 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-a03d896c-9d36-42e0-9b1a-10bbb1ed884c tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4" status: 200 len: 1270 microversion: 2.1 time: 0.243376 Feb 19 02:38:09.846017 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 535/1078] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:38:09 2021] GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4 => generated 1270 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 19 02:38:10.864178 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-db4af960-8e17-43a0-ae34-3444e728593e tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:38:10.864772 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-db4af960-8e17-43a0-ae34-3444e728593e tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: d1cba672-d813-45f4-ab87-e7ef1ce803e4] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:38:10.872801 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-db4af960-8e17-43a0-ae34-3444e728593e tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:10.873302 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-db4af960-8e17-43a0-ae34-3444e728593e tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:10.874224 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-db4af960-8e17-43a0-ae34-3444e728593e tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:10.874739 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-db4af960-8e17-43a0-ae34-3444e728593e tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:11.085537 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-7680e7de-2cc0-4dc5-888e-d1335cd0e97e req-3deb087f-8261-4dea-9fe7-7751a72385f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1cba672-d813-45f4-ab87-e7ef1ce803e4", "tag": "74c7bb13-b661-4bc1-8c0c-b971254d0c61"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:38:11.088006 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:38:11.088006 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:38:11.099513 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-7680e7de-2cc0-4dc5-888e-d1335cd0e97e req-3deb087f-8261-4dea-9fe7-7751a72385f0 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:11.100352 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-7680e7de-2cc0-4dc5-888e-d1335cd0e97e req-3deb087f-8261-4dea-9fe7-7751a72385f0 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:11.119865 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-7680e7de-2cc0-4dc5-888e-d1335cd0e97e req-3deb087f-8261-4dea-9fe7-7751a72385f0 service nova] Creating event network-changed:74c7bb13-b661-4bc1-8c0c-b971254d0c61 for instance d1cba672-d813-45f4-ab87-e7ef1ce803e4 on hv-cinder-77642 Feb 19 02:38:11.125702 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-7680e7de-2cc0-4dc5-888e-d1335cd0e97e req-3deb087f-8261-4dea-9fe7-7751a72385f0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048368 Feb 19 02:38:11.126391 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 536/1079] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:38:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:38:11.230185 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-db4af960-8e17-43a0-ae34-3444e728593e tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:38:11.239231 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-db4af960-8e17-43a0-ae34-3444e728593e tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4" status: 200 len: 1270 microversion: 2.1 time: 0.379340 Feb 19 02:38:11.239857 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 544/1080] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:38:10 2021] GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4 => generated 1270 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:38:12.258156 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-aeb08ee7-ffcb-49da-b3a7-6f6d55ef0059 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:38:12.259019 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-aeb08ee7-ffcb-49da-b3a7-6f6d55ef0059 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: d1cba672-d813-45f4-ab87-e7ef1ce803e4] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:38:12.267115 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-aeb08ee7-ffcb-49da-b3a7-6f6d55ef0059 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:12.267617 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-aeb08ee7-ffcb-49da-b3a7-6f6d55ef0059 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:12.268621 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-aeb08ee7-ffcb-49da-b3a7-6f6d55ef0059 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:12.269116 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-aeb08ee7-ffcb-49da-b3a7-6f6d55ef0059 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:12.499457 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-aeb08ee7-ffcb-49da-b3a7-6f6d55ef0059 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:38:12.511212 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-aeb08ee7-ffcb-49da-b3a7-6f6d55ef0059 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4" status: 200 len: 1270 microversion: 2.1 time: 0.257304 Feb 19 02:38:12.511793 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 537/1081] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:38:12 2021] GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4 => generated 1270 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:38:13.530160 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-9a9a3e63-ecc2-4973-bf2c-cf83b99bcb85 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:38:13.530879 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-9a9a3e63-ecc2-4973-bf2c-cf83b99bcb85 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: d1cba672-d813-45f4-ab87-e7ef1ce803e4] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:38:13.539090 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a9a3e63-ecc2-4973-bf2c-cf83b99bcb85 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:13.539605 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a9a3e63-ecc2-4973-bf2c-cf83b99bcb85 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:13.540438 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a9a3e63-ecc2-4973-bf2c-cf83b99bcb85 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:13.540930 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9a9a3e63-ecc2-4973-bf2c-cf83b99bcb85 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:13.749346 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9a9a3e63-ecc2-4973-bf2c-cf83b99bcb85 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:38:13.758142 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-9a9a3e63-ecc2-4973-bf2c-cf83b99bcb85 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4" status: 200 len: 1270 microversion: 2.1 time: 0.232138 Feb 19 02:38:13.758786 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 545/1082] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:38:13 2021] GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4 => generated 1270 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:38:14.377713 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 02:38:14.378009 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: Fri Feb 19 02:38:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 02:38:14.776199 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4cada43b-00e6-44b6-a3d0-5fed1ed1fedc tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:38:14.776788 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-4cada43b-00e6-44b6-a3d0-5fed1ed1fedc tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: d1cba672-d813-45f4-ab87-e7ef1ce803e4] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:38:14.784742 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4cada43b-00e6-44b6-a3d0-5fed1ed1fedc tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:14.785243 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4cada43b-00e6-44b6-a3d0-5fed1ed1fedc tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:14.786063 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4cada43b-00e6-44b6-a3d0-5fed1ed1fedc tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:14.786575 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4cada43b-00e6-44b6-a3d0-5fed1ed1fedc tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:15.001519 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-4cada43b-00e6-44b6-a3d0-5fed1ed1fedc tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:38:15.010493 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-4cada43b-00e6-44b6-a3d0-5fed1ed1fedc tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4" status: 200 len: 1270 microversion: 2.1 time: 0.238423 Feb 19 02:38:15.011246 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 538/1083] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:38:14 2021] GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4 => generated 1270 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:38:16.028508 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-72f8d5c0-fd10-4ffd-9df7-3c6f32c8f575 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:38:16.029183 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-72f8d5c0-fd10-4ffd-9df7-3c6f32c8f575 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: d1cba672-d813-45f4-ab87-e7ef1ce803e4] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:38:16.037776 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-72f8d5c0-fd10-4ffd-9df7-3c6f32c8f575 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:16.038280 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-72f8d5c0-fd10-4ffd-9df7-3c6f32c8f575 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:16.039141 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-72f8d5c0-fd10-4ffd-9df7-3c6f32c8f575 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:16.039633 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-72f8d5c0-fd10-4ffd-9df7-3c6f32c8f575 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:16.257282 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-72f8d5c0-fd10-4ffd-9df7-3c6f32c8f575 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:38:16.266616 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-72f8d5c0-fd10-4ffd-9df7-3c6f32c8f575 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4" status: 200 len: 1270 microversion: 2.1 time: 0.241756 Feb 19 02:38:16.267243 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 546/1084] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:38:16 2021] GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4 => generated 1270 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:38:17.284774 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-3e4d0965-8176-47e8-a54a-c1d44016e76f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:38:17.285369 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-3e4d0965-8176-47e8-a54a-c1d44016e76f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: d1cba672-d813-45f4-ab87-e7ef1ce803e4] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:38:17.293269 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3e4d0965-8176-47e8-a54a-c1d44016e76f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:17.293779 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3e4d0965-8176-47e8-a54a-c1d44016e76f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:17.294647 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3e4d0965-8176-47e8-a54a-c1d44016e76f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:17.295141 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3e4d0965-8176-47e8-a54a-c1d44016e76f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:17.505236 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-3e4d0965-8176-47e8-a54a-c1d44016e76f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:38:17.514037 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-3e4d0965-8176-47e8-a54a-c1d44016e76f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4" status: 200 len: 1270 microversion: 2.1 time: 0.233417 Feb 19 02:38:17.514681 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 539/1085] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:38:17 2021] GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4 => generated 1270 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:38:18.532827 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-dca9c7f6-8455-476e-bf56-934b2a3b723d tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:38:18.534131 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-dca9c7f6-8455-476e-bf56-934b2a3b723d tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: d1cba672-d813-45f4-ab87-e7ef1ce803e4] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:38:18.541912 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dca9c7f6-8455-476e-bf56-934b2a3b723d tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:18.542439 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dca9c7f6-8455-476e-bf56-934b2a3b723d tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:18.543273 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dca9c7f6-8455-476e-bf56-934b2a3b723d tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:18.543761 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-dca9c7f6-8455-476e-bf56-934b2a3b723d tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:18.700322 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-a325f941-bf86-43e3-9f71-776c70a2fb80 req-2fc40302-5a25-4bdd-afb1-2f04ec4b5516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1cba672-d813-45f4-ab87-e7ef1ce803e4", "name": "network-vif-plugged", "status": "completed", "tag": "74c7bb13-b661-4bc1-8c0c-b971254d0c61"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:38:18.708882 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:38:18.708882 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:38:18.718151 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-a325f941-bf86-43e3-9f71-776c70a2fb80 req-2fc40302-5a25-4bdd-afb1-2f04ec4b5516 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:18.718674 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-a325f941-bf86-43e3-9f71-776c70a2fb80 req-2fc40302-5a25-4bdd-afb1-2f04ec4b5516 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:18.736786 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-a325f941-bf86-43e3-9f71-776c70a2fb80 req-2fc40302-5a25-4bdd-afb1-2f04ec4b5516 service nova] Creating event network-vif-plugged:74c7bb13-b661-4bc1-8c0c-b971254d0c61 for instance d1cba672-d813-45f4-ab87-e7ef1ce803e4 on hv-cinder-77642 Feb 19 02:38:18.743293 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-a325f941-bf86-43e3-9f71-776c70a2fb80 req-2fc40302-5a25-4bdd-afb1-2f04ec4b5516 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109150 Feb 19 02:38:18.744335 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 540/1086] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:38:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:38:18.761501 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-dca9c7f6-8455-476e-bf56-934b2a3b723d tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:38:18.771503 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-dca9c7f6-8455-476e-bf56-934b2a3b723d tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4" status: 200 len: 1270 microversion: 2.1 time: 0.242817 Feb 19 02:38:18.772141 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 547/1087] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:38:18 2021] GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4 => generated 1270 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:38:19.791127 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ebebd708-5679-4871-9ccc-84550ba3e5c7 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:38:19.791901 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ebebd708-5679-4871-9ccc-84550ba3e5c7 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: d1cba672-d813-45f4-ab87-e7ef1ce803e4] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:38:19.800645 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ebebd708-5679-4871-9ccc-84550ba3e5c7 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:19.801155 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ebebd708-5679-4871-9ccc-84550ba3e5c7 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:19.802099 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ebebd708-5679-4871-9ccc-84550ba3e5c7 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:19.802651 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ebebd708-5679-4871-9ccc-84550ba3e5c7 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:20.022218 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ebebd708-5679-4871-9ccc-84550ba3e5c7 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:38:20.031900 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ebebd708-5679-4871-9ccc-84550ba3e5c7 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4" status: 200 len: 1270 microversion: 2.1 time: 0.245257 Feb 19 02:38:20.032747 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 541/1088] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:38:19 2021] GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4 => generated 1270 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:38:20.781368 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 02:38:20.781592 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: Fri Feb 19 02:38:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 02:38:21.050897 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-2e285db8-5c5c-4e5c-ab97-dc95b65c0f1a tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:38:21.051499 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-2e285db8-5c5c-4e5c-ab97-dc95b65c0f1a tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: d1cba672-d813-45f4-ab87-e7ef1ce803e4] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:38:21.059406 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2e285db8-5c5c-4e5c-ab97-dc95b65c0f1a tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:21.059910 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2e285db8-5c5c-4e5c-ab97-dc95b65c0f1a tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:21.060901 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2e285db8-5c5c-4e5c-ab97-dc95b65c0f1a tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:21.061390 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2e285db8-5c5c-4e5c-ab97-dc95b65c0f1a tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:21.279309 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-2e285db8-5c5c-4e5c-ab97-dc95b65c0f1a tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:38:21.288619 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-2e285db8-5c5c-4e5c-ab97-dc95b65c0f1a tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4" status: 200 len: 1457 microversion: 2.1 time: 0.241816 Feb 19 02:38:21.289241 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 548/1089] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:38:21 2021] GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4 => generated 1457 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:38:21.306277 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8a5f4e82-9dc5-4203-b9f7-17c37e517883 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:38:21.306913 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8a5f4e82-9dc5-4203-b9f7-17c37e517883 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: d1cba672-d813-45f4-ab87-e7ef1ce803e4] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:38:21.314784 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8a5f4e82-9dc5-4203-b9f7-17c37e517883 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:21.315325 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8a5f4e82-9dc5-4203-b9f7-17c37e517883 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:21.316165 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8a5f4e82-9dc5-4203-b9f7-17c37e517883 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:21.316648 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8a5f4e82-9dc5-4203-b9f7-17c37e517883 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:21.762828 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8a5f4e82-9dc5-4203-b9f7-17c37e517883 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:38:21.772227 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8a5f4e82-9dc5-4203-b9f7-17c37e517883 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4" status: 200 len: 1457 microversion: 2.1 time: 0.469936 Feb 19 02:38:21.772836 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 542/1090] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:38:21 2021] GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4 => generated 1457 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:38:21.790454 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e5961f22-5fcb-4a5d-9663-254b98440e96 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Action: 'create', calling method: .version_select at 0x7f21816fca60>, body: {"pool": null} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:38:23.759964 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e5961f22-5fcb-4a5d-9663-254b98440e96 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.973372 Feb 19 02:38:23.760617 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 549/1091] 10.222.0.44 () {60 vars in 1160 bytes} [Fri Feb 19 02:38:21 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1975 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:38:23.773272 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-b98dc00b-7394-4163-a2c4-24920fa43a13 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Action: 'action', calling method: .version_select at 0x7f217e37b950>, body: {"addFloatingIp": {"address": "172.27.1.188"}} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:38:23.774517 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-b98dc00b-7394-4163-a2c4-24920fa43a13 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: d1cba672-d813-45f4-ab87-e7ef1ce803e4] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:38:23.782396 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b98dc00b-7394-4163-a2c4-24920fa43a13 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:23.783531 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b98dc00b-7394-4163-a2c4-24920fa43a13 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:23.784361 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b98dc00b-7394-4163-a2c4-24920fa43a13 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:23.784852 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b98dc00b-7394-4163-a2c4-24920fa43a13 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:23.848253 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b98dc00b-7394-4163-a2c4-24920fa43a13 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Acquired lock "refresh_cache-d1cba672-d813-45f4-ab87-e7ef1ce803e4" {{(pid=98194) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 19 02:38:25.571946 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-b98dc00b-7394-4163-a2c4-24920fa43a13 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: d1cba672-d813-45f4-ab87-e7ef1ce803e4] Building network info cache for instance {{(pid=98194) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 19 02:38:25.637662 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-7979cb18-c144-47a4-9a47-cee6e332b84e req-16ef507b-ead5-4fd9-96fc-c429649e57bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1cba672-d813-45f4-ab87-e7ef1ce803e4", "tag": "74c7bb13-b661-4bc1-8c0c-b971254d0c61"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:38:25.639777 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:38:25.639777 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:38:25.648555 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-7979cb18-c144-47a4-9a47-cee6e332b84e req-16ef507b-ead5-4fd9-96fc-c429649e57bb service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:38:25.649036 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-7979cb18-c144-47a4-9a47-cee6e332b84e req-16ef507b-ead5-4fd9-96fc-c429649e57bb service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:38:25.667346 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-7979cb18-c144-47a4-9a47-cee6e332b84e req-16ef507b-ead5-4fd9-96fc-c429649e57bb service nova] Creating event network-changed:74c7bb13-b661-4bc1-8c0c-b971254d0c61 for instance d1cba672-d813-45f4-ab87-e7ef1ce803e4 on hv-cinder-77642 Feb 19 02:38:25.673009 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-7979cb18-c144-47a4-9a47-cee6e332b84e req-16ef507b-ead5-4fd9-96fc-c429649e57bb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095841 Feb 19 02:38:25.674659 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 550/1092] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:38:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:38:26.701997 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-b98dc00b-7394-4163-a2c4-24920fa43a13 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: d1cba672-d813-45f4-ab87-e7ef1ce803e4] Updating instance_info_cache with network_info: [{"id": "74c7bb13-b661-4bc1-8c0c-b971254d0c61", "address": "fa:16:3e:b6:c6:e8", "network": {"id": "d7a3d9c7-d762-4eea-968f-4f012d4c747a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1263351507-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.1.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3b0847ee05c643e981b009b8bc77c1aa", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap74c7bb13-b6", "ovs_interfaceid": "74c7bb13-b661-4bc1-8c0c-b971254d0c61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98194) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 19 02:38:26.714544 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-b98dc00b-7394-4163-a2c4-24920fa43a13 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Releasing lock "refresh_cache-d1cba672-d813-45f4-ab87-e7ef1ce803e4" {{(pid=98194) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 19 02:38:26.715821 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-b98dc00b-7394-4163-a2c4-24920fa43a13 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "POST /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4/action" status: 202 len: 0 microversion: 2.1 time: 2.946682 Feb 19 02:38:26.717852 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 543/1093] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:38:23 2021] POST /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4/action => generated 0 bytes in 2949 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 19 02:39:53.056426 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-f89bbde6-11c6-4543-9f15-2c22f1fca8d8 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1419992935", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-483956370", "security_groups": [{"name": "tempest-TestVolumeBootPattern-89846141"}], "block_device_mapping_v2": [{"uuid": "972cc480-a21a-4e5a-88ad-1060c79df2d7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d7a3d9c7-d762-4eea-968f-4f012d4c747a"}]}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:39:53.224989 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-f89bbde6-11c6-4543-9f15-2c22f1fca8d8 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] validate_networks() for [('d7a3d9c7-d762-4eea-968f-4f012d4c747a', None, None, None)] {{(pid=98193) validate_networks /opt/stack/nova/nova/network/neutron.py:2345}} Feb 19 02:39:53.801501 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-f89bbde6-11c6-4543-9f15-2c22f1fca8d8 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Flavor limits 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 19 02:39:53.801974 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-f89bbde6-11c6-4543-9f15-2c22f1fca8d8 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Image limits 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:351}} Feb 19 02:39:53.802552 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-f89bbde6-11c6-4543-9f15-2c22f1fca8d8 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Flavor pref 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 19 02:39:53.803012 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-f89bbde6-11c6-4543-9f15-2c22f1fca8d8 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Image pref 0:0:0 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:391}} Feb 19 02:39:53.803472 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.virt.hardware [None req-f89bbde6-11c6-4543-9f15-2c22f1fca8d8 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98193) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:431}} Feb 19 02:39:53.812226 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f89bbde6-11c6-4543-9f15-2c22f1fca8d8 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:39:53.812729 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f89bbde6-11c6-4543-9f15-2c22f1fca8d8 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:39:53.813593 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f89bbde6-11c6-4543-9f15-2c22f1fca8d8 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:39:53.814089 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-f89bbde6-11c6-4543-9f15-2c22f1fca8d8 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:39:53.832749 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-f89bbde6-11c6-4543-9f15-2c22f1fca8d8 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Getting quotas for project 3b0847ee05c643e981b009b8bc77c1aa. Resources: {'ram', 'instances', 'cores'} {{(pid=98193) _get_quotas /opt/stack/nova/nova/quota.py:388}} Feb 19 02:39:53.836967 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.quota [None req-f89bbde6-11c6-4543-9f15-2c22f1fca8d8 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Getting quotas for user 4372723bc6674cb4972c619b77ae55db and project 3b0847ee05c643e981b009b8bc77c1aa. Resources: {'ram', 'instances', 'cores'} {{(pid=98193) _get_quotas /opt/stack/nova/nova/quota.py:380}} Feb 19 02:39:53.940945 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f89bbde6-11c6-4543-9f15-2c22f1fca8d8 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Going to run 1 instances... {{(pid=98193) _provision_instances /opt/stack/nova/nova/compute/api.py:1264}} Feb 19 02:39:53.943580 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-f89bbde6-11c6-4543-9f15-2c22f1fca8d8 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: 7935c2fe-742f-47d5-a02f-c4c72a29e7c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='972cc480-a21a-4e5a-88ad-1060c79df2d7',volume_size=None,volume_type=None)] {{(pid=98193) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1666}} Feb 19 02:39:54.117665 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-f89bbde6-11c6-4543-9f15-2c22f1fca8d8 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 411 microversion: 2.1 time: 1.065880 Feb 19 02:39:54.118383 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 551/1094] 10.222.0.44 () {60 vars in 1137 bytes} [Fri Feb 19 02:39:53 2021] POST /compute/v2.1/servers => generated 411 bytes in 1068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Feb 19 02:39:54.129605 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d477df26-8404-494e-9f60-081a57df7718 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:39:54.130267 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d477df26-8404-494e-9f60-081a57df7718 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: 7935c2fe-742f-47d5-a02f-c4c72a29e7c4] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:39:54.210153 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-d477df26-8404-494e-9f60-081a57df7718 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:39:54.220897 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d477df26-8404-494e-9f60-081a57df7718 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4" status: 200 len: 1094 microversion: 2.1 time: 0.095810 Feb 19 02:39:54.221514 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 544/1095] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:39:54 2021] GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4 => generated 1094 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:39:55.239232 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-fa2ee47f-9cf7-4e6e-bb64-37c4d9c7af18 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:39:55.240147 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-fa2ee47f-9cf7-4e6e-bb64-37c4d9c7af18 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: 7935c2fe-742f-47d5-a02f-c4c72a29e7c4] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:39:55.249569 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fa2ee47f-9cf7-4e6e-bb64-37c4d9c7af18 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:39:55.250105 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fa2ee47f-9cf7-4e6e-bb64-37c4d9c7af18 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:39:55.250974 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fa2ee47f-9cf7-4e6e-bb64-37c4d9c7af18 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:39:55.251464 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-fa2ee47f-9cf7-4e6e-bb64-37c4d9c7af18 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:39:55.396099 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-fa2ee47f-9cf7-4e6e-bb64-37c4d9c7af18 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:39:55.405303 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-fa2ee47f-9cf7-4e6e-bb64-37c4d9c7af18 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4" status: 200 len: 1210 microversion: 2.1 time: 0.170265 Feb 19 02:39:55.405913 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 552/1096] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:39:55 2021] GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4 => generated 1210 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:39:56.424475 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-22ceb1d3-6ab3-4a2e-beb8-c8cb12c8f957 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:39:56.425327 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-22ceb1d3-6ab3-4a2e-beb8-c8cb12c8f957 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: 7935c2fe-742f-47d5-a02f-c4c72a29e7c4] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:39:56.434016 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-22ceb1d3-6ab3-4a2e-beb8-c8cb12c8f957 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:39:56.434662 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-22ceb1d3-6ab3-4a2e-beb8-c8cb12c8f957 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:39:56.435549 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-22ceb1d3-6ab3-4a2e-beb8-c8cb12c8f957 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:39:56.436173 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-22ceb1d3-6ab3-4a2e-beb8-c8cb12c8f957 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:39:56.656643 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-22ceb1d3-6ab3-4a2e-beb8-c8cb12c8f957 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:39:56.665603 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-22ceb1d3-6ab3-4a2e-beb8-c8cb12c8f957 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4" status: 200 len: 1271 microversion: 2.1 time: 0.245711 Feb 19 02:39:56.666193 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 545/1097] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:39:56 2021] GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4 => generated 1271 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:39:57.684071 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-7194ea62-dc36-439c-a9a8-eff5ab3d219d tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:39:57.684685 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-7194ea62-dc36-439c-a9a8-eff5ab3d219d tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: 7935c2fe-742f-47d5-a02f-c4c72a29e7c4] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:39:57.693243 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7194ea62-dc36-439c-a9a8-eff5ab3d219d tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:39:57.693744 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7194ea62-dc36-439c-a9a8-eff5ab3d219d tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:39:57.694636 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7194ea62-dc36-439c-a9a8-eff5ab3d219d tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:39:57.695132 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-7194ea62-dc36-439c-a9a8-eff5ab3d219d tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:39:58.100047 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-7194ea62-dc36-439c-a9a8-eff5ab3d219d tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:39:58.113594 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-7194ea62-dc36-439c-a9a8-eff5ab3d219d tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4" status: 200 len: 1271 microversion: 2.1 time: 0.433452 Feb 19 02:39:58.115093 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 553/1098] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:39:57 2021] GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4 => generated 1271 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:39:58.146165 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-6065bca6-648a-4f8e-bb89-d3e13bc24546 req-cd3a6a94-66f1-4b72-9e88-e16f222a7043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7935c2fe-742f-47d5-a02f-c4c72a29e7c4", "tag": "fe990f66-c038-4176-b18a-30d887d98c87"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:39:58.148142 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:39:58.148142 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:39:58.158406 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-6065bca6-648a-4f8e-bb89-d3e13bc24546 req-cd3a6a94-66f1-4b72-9e88-e16f222a7043 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:39:58.158911 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-6065bca6-648a-4f8e-bb89-d3e13bc24546 req-cd3a6a94-66f1-4b72-9e88-e16f222a7043 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:39:58.176636 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-6065bca6-648a-4f8e-bb89-d3e13bc24546 req-cd3a6a94-66f1-4b72-9e88-e16f222a7043 service nova] Creating event network-changed:fe990f66-c038-4176-b18a-30d887d98c87 for instance 7935c2fe-742f-47d5-a02f-c4c72a29e7c4 on hv-cinder-77642 Feb 19 02:39:58.181698 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-6065bca6-648a-4f8e-bb89-d3e13bc24546 req-cd3a6a94-66f1-4b72-9e88-e16f222a7043 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162730 Feb 19 02:39:58.182335 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 546/1099] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:39:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:39:59.132807 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-2eec49b3-d94d-46f7-bd64-9c61af6d471c tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:39:59.133569 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-2eec49b3-d94d-46f7-bd64-9c61af6d471c tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: 7935c2fe-742f-47d5-a02f-c4c72a29e7c4] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:39:59.141490 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2eec49b3-d94d-46f7-bd64-9c61af6d471c tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:39:59.142103 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2eec49b3-d94d-46f7-bd64-9c61af6d471c tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:39:59.143012 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2eec49b3-d94d-46f7-bd64-9c61af6d471c tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:39:59.143506 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-2eec49b3-d94d-46f7-bd64-9c61af6d471c tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:39:59.500244 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-2eec49b3-d94d-46f7-bd64-9c61af6d471c tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:39:59.509674 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-2eec49b3-d94d-46f7-bd64-9c61af6d471c tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4" status: 200 len: 1271 microversion: 2.1 time: 0.380864 Feb 19 02:39:59.510445 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 554/1100] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:39:59 2021] GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4 => generated 1271 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:40:00.529307 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-ee52cc6c-dd37-454d-a227-7d9f13c2f18d tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:40:00.530149 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-ee52cc6c-dd37-454d-a227-7d9f13c2f18d tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: 7935c2fe-742f-47d5-a02f-c4c72a29e7c4] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:40:00.538866 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ee52cc6c-dd37-454d-a227-7d9f13c2f18d tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:40:00.539380 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ee52cc6c-dd37-454d-a227-7d9f13c2f18d tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:40:00.540212 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ee52cc6c-dd37-454d-a227-7d9f13c2f18d tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:40:00.540704 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-ee52cc6c-dd37-454d-a227-7d9f13c2f18d tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:40:00.754021 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-ee52cc6c-dd37-454d-a227-7d9f13c2f18d tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:40:00.763097 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-ee52cc6c-dd37-454d-a227-7d9f13c2f18d tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4" status: 200 len: 1271 microversion: 2.1 time: 0.238273 Feb 19 02:40:00.763708 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 547/1101] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:40:00 2021] GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4 => generated 1271 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:40:01.781096 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-246df1fa-586d-47fa-9b83-94ecf81b2cac tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:40:01.781764 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-246df1fa-586d-47fa-9b83-94ecf81b2cac tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: 7935c2fe-742f-47d5-a02f-c4c72a29e7c4] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:40:01.790141 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-246df1fa-586d-47fa-9b83-94ecf81b2cac tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:40:01.790698 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-246df1fa-586d-47fa-9b83-94ecf81b2cac tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:40:01.791525 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-246df1fa-586d-47fa-9b83-94ecf81b2cac tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:40:01.792014 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-246df1fa-586d-47fa-9b83-94ecf81b2cac tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:40:02.008734 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-246df1fa-586d-47fa-9b83-94ecf81b2cac tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:40:02.017984 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-246df1fa-586d-47fa-9b83-94ecf81b2cac tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4" status: 200 len: 1271 microversion: 2.1 time: 0.240807 Feb 19 02:40:02.018630 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 555/1102] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:40:01 2021] GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4 => generated 1271 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:40:03.036402 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-50bce3b3-284c-4770-940a-f3dc1a1863c2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:40:03.037100 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-50bce3b3-284c-4770-940a-f3dc1a1863c2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: 7935c2fe-742f-47d5-a02f-c4c72a29e7c4] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:40:03.045065 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-50bce3b3-284c-4770-940a-f3dc1a1863c2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:40:03.045564 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-50bce3b3-284c-4770-940a-f3dc1a1863c2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:40:03.046402 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-50bce3b3-284c-4770-940a-f3dc1a1863c2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:40:03.046891 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-50bce3b3-284c-4770-940a-f3dc1a1863c2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:40:03.256152 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-50bce3b3-284c-4770-940a-f3dc1a1863c2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:40:03.265031 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-50bce3b3-284c-4770-940a-f3dc1a1863c2 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4" status: 200 len: 1271 microversion: 2.1 time: 0.232885 Feb 19 02:40:03.265646 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 548/1103] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:40:03 2021] GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4 => generated 1271 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:40:04.283958 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-4edaa28b-ecf2-47ba-b20f-5d955e8d65c7 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:40:04.284601 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-4edaa28b-ecf2-47ba-b20f-5d955e8d65c7 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: 7935c2fe-742f-47d5-a02f-c4c72a29e7c4] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:40:04.292466 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4edaa28b-ecf2-47ba-b20f-5d955e8d65c7 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:40:04.292969 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4edaa28b-ecf2-47ba-b20f-5d955e8d65c7 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:40:04.293882 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4edaa28b-ecf2-47ba-b20f-5d955e8d65c7 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:40:04.294382 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-4edaa28b-ecf2-47ba-b20f-5d955e8d65c7 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:40:04.505028 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-4edaa28b-ecf2-47ba-b20f-5d955e8d65c7 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:40:04.513994 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-4edaa28b-ecf2-47ba-b20f-5d955e8d65c7 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4" status: 200 len: 1271 microversion: 2.1 time: 0.234315 Feb 19 02:40:04.514647 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 556/1104] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:40:04 2021] GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4 => generated 1271 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:40:05.532151 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c9044c05-0ac9-44a2-8245-3634daa04797 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:40:05.532798 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c9044c05-0ac9-44a2-8245-3634daa04797 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: 7935c2fe-742f-47d5-a02f-c4c72a29e7c4] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:40:05.540631 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c9044c05-0ac9-44a2-8245-3634daa04797 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:40:05.541188 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c9044c05-0ac9-44a2-8245-3634daa04797 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:40:05.542018 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c9044c05-0ac9-44a2-8245-3634daa04797 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:40:05.542536 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c9044c05-0ac9-44a2-8245-3634daa04797 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:40:05.756961 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c9044c05-0ac9-44a2-8245-3634daa04797 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:40:05.765715 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c9044c05-0ac9-44a2-8245-3634daa04797 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4" status: 200 len: 1271 microversion: 2.1 time: 0.237621 Feb 19 02:40:05.766333 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 549/1105] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:40:05 2021] GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4 => generated 1271 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:40:06.784460 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-239dac33-3eba-40a3-9e3d-228054cc4999 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:40:06.785114 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-239dac33-3eba-40a3-9e3d-228054cc4999 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: 7935c2fe-742f-47d5-a02f-c4c72a29e7c4] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:40:06.792920 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-239dac33-3eba-40a3-9e3d-228054cc4999 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:40:06.793413 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-239dac33-3eba-40a3-9e3d-228054cc4999 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:40:06.794233 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-239dac33-3eba-40a3-9e3d-228054cc4999 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:40:06.794742 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-239dac33-3eba-40a3-9e3d-228054cc4999 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:40:07.006286 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-239dac33-3eba-40a3-9e3d-228054cc4999 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:40:07.015150 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-239dac33-3eba-40a3-9e3d-228054cc4999 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4" status: 200 len: 1271 microversion: 2.1 time: 0.235010 Feb 19 02:40:07.015766 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 557/1106] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:40:06 2021] GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4 => generated 1271 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:40:07.561012 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-896b52e9-a9db-4b49-acce-745dc8668ea4 req-4866f4d7-046c-4782-8cc9-c5fe14b37305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7935c2fe-742f-47d5-a02f-c4c72a29e7c4", "name": "network-vif-plugged", "status": "completed", "tag": "fe990f66-c038-4176-b18a-30d887d98c87"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:40:07.562726 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:40:07.562726 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:40:07.572063 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-896b52e9-a9db-4b49-acce-745dc8668ea4 req-4866f4d7-046c-4782-8cc9-c5fe14b37305 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:40:07.572559 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-896b52e9-a9db-4b49-acce-745dc8668ea4 req-4866f4d7-046c-4782-8cc9-c5fe14b37305 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:40:07.592865 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-896b52e9-a9db-4b49-acce-745dc8668ea4 req-4866f4d7-046c-4782-8cc9-c5fe14b37305 service nova] Creating event network-vif-plugged:fe990f66-c038-4176-b18a-30d887d98c87 for instance 7935c2fe-742f-47d5-a02f-c4c72a29e7c4 on hv-cinder-77642 Feb 19 02:40:07.597963 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-896b52e9-a9db-4b49-acce-745dc8668ea4 req-4866f4d7-046c-4782-8cc9-c5fe14b37305 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040842 Feb 19 02:40:07.598667 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 550/1107] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:40:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:40:08.033771 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-0403223a-9812-41f0-a2cf-2bd680d058c5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:40:08.034460 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-0403223a-9812-41f0-a2cf-2bd680d058c5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: 7935c2fe-742f-47d5-a02f-c4c72a29e7c4] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:40:08.042460 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0403223a-9812-41f0-a2cf-2bd680d058c5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:40:08.042965 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0403223a-9812-41f0-a2cf-2bd680d058c5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:40:08.043798 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0403223a-9812-41f0-a2cf-2bd680d058c5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:40:08.044288 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-0403223a-9812-41f0-a2cf-2bd680d058c5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:40:08.252240 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-0403223a-9812-41f0-a2cf-2bd680d058c5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:40:08.261109 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-0403223a-9812-41f0-a2cf-2bd680d058c5 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4" status: 200 len: 1271 microversion: 2.1 time: 0.231528 Feb 19 02:40:08.261728 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 558/1108] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:40:08 2021] GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4 => generated 1271 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:40:09.280478 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-e415c48b-18cb-45e8-905a-1bd65db60e23 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:40:09.281160 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-e415c48b-18cb-45e8-905a-1bd65db60e23 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: 7935c2fe-742f-47d5-a02f-c4c72a29e7c4] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:40:09.289624 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e415c48b-18cb-45e8-905a-1bd65db60e23 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:40:09.290125 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e415c48b-18cb-45e8-905a-1bd65db60e23 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:40:09.290965 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e415c48b-18cb-45e8-905a-1bd65db60e23 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:40:09.291459 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-e415c48b-18cb-45e8-905a-1bd65db60e23 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:40:09.504111 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-e415c48b-18cb-45e8-905a-1bd65db60e23 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:40:09.513121 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-e415c48b-18cb-45e8-905a-1bd65db60e23 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4" status: 200 len: 1459 microversion: 2.1 time: 0.237289 Feb 19 02:40:09.513798 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 551/1109] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:40:09 2021] GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4 => generated 1459 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:40:09.530841 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-947b0bd6-a623-4433-9306-4bbfb9642d9b tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:40:09.531448 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-947b0bd6-a623-4433-9306-4bbfb9642d9b tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: 7935c2fe-742f-47d5-a02f-c4c72a29e7c4] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:40:09.539818 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-947b0bd6-a623-4433-9306-4bbfb9642d9b tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:40:09.540325 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-947b0bd6-a623-4433-9306-4bbfb9642d9b tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:40:09.541149 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-947b0bd6-a623-4433-9306-4bbfb9642d9b tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:40:09.541639 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-947b0bd6-a623-4433-9306-4bbfb9642d9b tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:40:09.751412 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-947b0bd6-a623-4433-9306-4bbfb9642d9b tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:40:09.760448 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-947b0bd6-a623-4433-9306-4bbfb9642d9b tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4" status: 200 len: 1459 microversion: 2.1 time: 0.233642 Feb 19 02:40:09.761073 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 559/1110] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:40:09 2021] GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4 => generated 1459 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:40:09.778662 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c9d4f2f3-d8c2-43ce-a44a-07dfed805718 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Action: 'create', calling method: .version_select at 0x7f217d6c0268>, body: {"pool": null} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:40:11.781130 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c9d4f2f3-d8c2-43ce-a44a-07dfed805718 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.006389 Feb 19 02:40:11.781811 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 552/1111] 10.222.0.44 () {60 vars in 1160 bytes} [Fri Feb 19 02:40:09 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2008 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:40:11.793978 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-6bd889f2-f02e-4640-b7a0-788f71ec583f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.27.1.196"}} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:40:11.795319 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-6bd889f2-f02e-4640-b7a0-788f71ec583f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: 7935c2fe-742f-47d5-a02f-c4c72a29e7c4] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:40:11.803123 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6bd889f2-f02e-4640-b7a0-788f71ec583f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:40:11.803623 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6bd889f2-f02e-4640-b7a0-788f71ec583f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:40:11.804448 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6bd889f2-f02e-4640-b7a0-788f71ec583f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:40:11.804931 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6bd889f2-f02e-4640-b7a0-788f71ec583f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:40:11.872285 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6bd889f2-f02e-4640-b7a0-788f71ec583f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Acquired lock "refresh_cache-7935c2fe-742f-47d5-a02f-c4c72a29e7c4" {{(pid=98193) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 19 02:40:13.846319 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-6bd889f2-f02e-4640-b7a0-788f71ec583f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: 7935c2fe-742f-47d5-a02f-c4c72a29e7c4] Building network info cache for instance {{(pid=98193) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 19 02:40:13.854789 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-33101808-32b9-4ecd-ae70-4c96a5f345be req-af04ac2b-6260-4c21-b937-e4b02391f92c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7935c2fe-742f-47d5-a02f-c4c72a29e7c4", "tag": "fe990f66-c038-4176-b18a-30d887d98c87"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:40:13.856522 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:40:13.856522 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:40:13.868032 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-33101808-32b9-4ecd-ae70-4c96a5f345be req-af04ac2b-6260-4c21-b937-e4b02391f92c service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:40:13.869190 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-33101808-32b9-4ecd-ae70-4c96a5f345be req-af04ac2b-6260-4c21-b937-e4b02391f92c service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:40:13.887723 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-33101808-32b9-4ecd-ae70-4c96a5f345be req-af04ac2b-6260-4c21-b937-e4b02391f92c service nova] Creating event network-changed:fe990f66-c038-4176-b18a-30d887d98c87 for instance 7935c2fe-742f-47d5-a02f-c4c72a29e7c4 on hv-cinder-77642 Feb 19 02:40:13.893117 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-33101808-32b9-4ecd-ae70-4c96a5f345be req-af04ac2b-6260-4c21-b937-e4b02391f92c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042281 Feb 19 02:40:13.893753 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 553/1112] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:40:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:40:15.511863 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-6bd889f2-f02e-4640-b7a0-788f71ec583f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: 7935c2fe-742f-47d5-a02f-c4c72a29e7c4] Updating instance_info_cache with network_info: [{"id": "fe990f66-c038-4176-b18a-30d887d98c87", "address": "fa:16:3e:60:2c:80", "network": {"id": "d7a3d9c7-d762-4eea-968f-4f012d4c747a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1263351507-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.27.1.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3b0847ee05c643e981b009b8bc77c1aa", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapfe990f66-c0", "ovs_interfaceid": "fe990f66-c038-4176-b18a-30d887d98c87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98193) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 19 02:40:15.523029 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-6bd889f2-f02e-4640-b7a0-788f71ec583f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Releasing lock "refresh_cache-7935c2fe-742f-47d5-a02f-c4c72a29e7c4" {{(pid=98193) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 19 02:40:15.523949 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-6bd889f2-f02e-4640-b7a0-788f71ec583f tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "POST /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4/action" status: 202 len: 0 microversion: 2.1 time: 3.734046 Feb 19 02:40:15.524803 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 560/1113] 10.222.0.44 () {60 vars in 1268 bytes} [Fri Feb 19 02:40:11 2021] POST /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4/action => generated 0 bytes in 3735 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Feb 19 02:41:19.572101 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 02:41:19.572690 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: Fri Feb 19 02:41:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 02:41:34.013965 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: ERROR oslo.messaging._drivers.impl_rabbit [-] [404af4ea-fd5e-424a-8ccf-345b909fc274] AMQP server on 10.222.0.44:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Feb 19 02:41:34.065489 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-93e16a87-b04f-4853-9ae7-492c1b570796 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '.version_select at 0x7f217d6c0f28>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:41:34.395746 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 02:41:34.395907 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: Fri Feb 19 02:41:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 02:41:34.829037 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-93e16a87-b04f-4853-9ae7-492c1b570796 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: 7935c2fe-742f-47d5-a02f-c4c72a29e7c4] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:41:34.838057 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-93e16a87-b04f-4853-9ae7-492c1b570796 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:34.838590 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-93e16a87-b04f-4853-9ae7-492c1b570796 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:34.839430 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-93e16a87-b04f-4853-9ae7-492c1b570796 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:34.839913 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-93e16a87-b04f-4853-9ae7-492c1b570796 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:34.902115 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-93e16a87-b04f-4853-9ae7-492c1b570796 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Acquired lock "refresh_cache-7935c2fe-742f-47d5-a02f-c4c72a29e7c4" {{(pid=98194) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 19 02:41:35.036555 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO oslo.messaging._drivers.impl_rabbit [-] [404af4ea-fd5e-424a-8ccf-345b909fc274] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 54382. Feb 19 02:41:36.641442 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-93e16a87-b04f-4853-9ae7-492c1b570796 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: 7935c2fe-742f-47d5-a02f-c4c72a29e7c4] Building network info cache for instance {{(pid=98194) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 19 02:41:36.651242 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-7dec3472-5d61-45bb-b21e-ec6f31cb59fa req-b0f46cee-744f-4283-8cdc-645ef1ff7257 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7935c2fe-742f-47d5-a02f-c4c72a29e7c4", "tag": "fe990f66-c038-4176-b18a-30d887d98c87"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:41:36.652941 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:41:36.652941 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:41:36.656975 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ae901456-ab94-4419-90d8-7d9b28435724] AMQP server on 10.222.0.44:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Feb 19 02:41:36.670087 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-7dec3472-5d61-45bb-b21e-ec6f31cb59fa req-b0f46cee-744f-4283-8cdc-645ef1ff7257 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:36.670894 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-7dec3472-5d61-45bb-b21e-ec6f31cb59fa req-b0f46cee-744f-4283-8cdc-645ef1ff7257 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:36.688402 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-7dec3472-5d61-45bb-b21e-ec6f31cb59fa req-b0f46cee-744f-4283-8cdc-645ef1ff7257 service nova] Creating event network-changed:fe990f66-c038-4176-b18a-30d887d98c87 for instance 7935c2fe-742f-47d5-a02f-c4c72a29e7c4 on hv-cinder-77642 Feb 19 02:41:36.694438 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-7dec3472-5d61-45bb-b21e-ec6f31cb59fa req-b0f46cee-744f-4283-8cdc-645ef1ff7257 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046835 Feb 19 02:41:36.695077 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 561/1114] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:41:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:41:37.512400 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-93e16a87-b04f-4853-9ae7-492c1b570796 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: 7935c2fe-742f-47d5-a02f-c4c72a29e7c4] Updating instance_info_cache with network_info: [{"id": "fe990f66-c038-4176-b18a-30d887d98c87", "address": "fa:16:3e:60:2c:80", "network": {"id": "d7a3d9c7-d762-4eea-968f-4f012d4c747a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1263351507-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3b0847ee05c643e981b009b8bc77c1aa", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tapfe990f66-c0", "ovs_interfaceid": "fe990f66-c038-4176-b18a-30d887d98c87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98194) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 19 02:41:37.523254 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-93e16a87-b04f-4853-9ae7-492c1b570796 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Releasing lock "refresh_cache-7935c2fe-742f-47d5-a02f-c4c72a29e7c4" {{(pid=98194) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 19 02:41:37.524488 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-93e16a87-b04f-4853-9ae7-492c1b570796 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "DELETE /compute/v2.1/os-floating-ips/a0979401-5b57-4cd7-a440-24d92683f284" status: 202 len: 0 microversion: 2.1 time: 3.511770 Feb 19 02:41:37.525179 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 554/1115] 10.222.0.44 () {58 vars in 1253 bytes} [Fri Feb 19 02:41:34 2021] DELETE /compute/v2.1/os-floating-ips/a0979401-5b57-4cd7-a440-24d92683f284 => generated 0 bytes in 3513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:41:37.535259 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-73755326-5ead-45e1-b60b-de8902de9cdd tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:41:37.535907 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-73755326-5ead-45e1-b60b-de8902de9cdd tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: 7935c2fe-742f-47d5-a02f-c4c72a29e7c4] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:41:37.544178 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-73755326-5ead-45e1-b60b-de8902de9cdd tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:37.544680 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-73755326-5ead-45e1-b60b-de8902de9cdd tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:37.545515 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-73755326-5ead-45e1-b60b-de8902de9cdd tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:37.546003 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-73755326-5ead-45e1-b60b-de8902de9cdd tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:37.612216 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-73755326-5ead-45e1-b60b-de8902de9cdd tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: 7935c2fe-742f-47d5-a02f-c4c72a29e7c4] Going to try to terminate instance {{(pid=98193) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 02:41:37.699719 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO oslo.messaging._drivers.impl_rabbit [-] [ae901456-ab94-4419-90d8-7d9b28435724] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 54390. Feb 19 02:41:37.741793 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-73755326-5ead-45e1-b60b-de8902de9cdd tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4" status: 204 len: 0 microversion: 2.1 time: 0.211039 Feb 19 02:41:37.742550 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 562/1116] 10.222.0.44 () {58 vars in 1229 bytes} [Fri Feb 19 02:41:37 2021] DELETE /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 02:41:37.751331 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-3e24cc84-84f3-41c0-b5c2-99e4c1acee21 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:41:37.752153 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-3e24cc84-84f3-41c0-b5c2-99e4c1acee21 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: 7935c2fe-742f-47d5-a02f-c4c72a29e7c4] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:41:37.760413 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3e24cc84-84f3-41c0-b5c2-99e4c1acee21 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:37.760866 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3e24cc84-84f3-41c0-b5c2-99e4c1acee21 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:37.761794 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3e24cc84-84f3-41c0-b5c2-99e4c1acee21 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:37.762288 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-3e24cc84-84f3-41c0-b5c2-99e4c1acee21 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:37.992611 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-3e24cc84-84f3-41c0-b5c2-99e4c1acee21 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:41:38.002006 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-3e24cc84-84f3-41c0-b5c2-99e4c1acee21 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4" status: 200 len: 1465 microversion: 2.1 time: 0.254961 Feb 19 02:41:38.002672 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 555/1117] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:41:37 2021] GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4 => generated 1465 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:41:39.020596 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8d7dd2b6-dd2e-49f4-8dd8-9e09d6d4693b tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:41:39.021373 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8d7dd2b6-dd2e-49f4-8dd8-9e09d6d4693b tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: 7935c2fe-742f-47d5-a02f-c4c72a29e7c4] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:41:39.029256 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8d7dd2b6-dd2e-49f4-8dd8-9e09d6d4693b tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:39.029769 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8d7dd2b6-dd2e-49f4-8dd8-9e09d6d4693b tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:39.030632 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8d7dd2b6-dd2e-49f4-8dd8-9e09d6d4693b tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:39.031128 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8d7dd2b6-dd2e-49f4-8dd8-9e09d6d4693b tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:39.348504 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8d7dd2b6-dd2e-49f4-8dd8-9e09d6d4693b tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:41:39.357416 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8d7dd2b6-dd2e-49f4-8dd8-9e09d6d4693b tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4" status: 200 len: 1465 microversion: 2.1 time: 0.341413 Feb 19 02:41:39.358038 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 563/1118] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:41:39 2021] GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4 => generated 1465 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:41:39.570699 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-8ceaf36b-7689-4518-8e30-56735e85f342 req-58a3e2b1-9b81-48c4-b628-590566988001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7935c2fe-742f-47d5-a02f-c4c72a29e7c4", "name": "network-vif-unplugged", "status": "completed", "tag": "fe990f66-c038-4176-b18a-30d887d98c87"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:41:39.572772 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:41:39.572772 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:41:39.583245 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-8ceaf36b-7689-4518-8e30-56735e85f342 req-58a3e2b1-9b81-48c4-b628-590566988001 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:39.583887 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-8ceaf36b-7689-4518-8e30-56735e85f342 req-58a3e2b1-9b81-48c4-b628-590566988001 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:39.602485 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-8ceaf36b-7689-4518-8e30-56735e85f342 req-58a3e2b1-9b81-48c4-b628-590566988001 service nova] Creating event network-vif-unplugged:fe990f66-c038-4176-b18a-30d887d98c87 for instance 7935c2fe-742f-47d5-a02f-c4c72a29e7c4 on hv-cinder-77642 Feb 19 02:41:39.608146 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-8ceaf36b-7689-4518-8e30-56735e85f342 req-58a3e2b1-9b81-48c4-b628-590566988001 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041635 Feb 19 02:41:39.609065 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 556/1119] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:41:39 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 19 02:41:40.375668 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-8cf02fe5-ca8e-4a37-8503-f8051b00d467 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:41:40.376331 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-8cf02fe5-ca8e-4a37-8503-f8051b00d467 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: 7935c2fe-742f-47d5-a02f-c4c72a29e7c4] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:41:40.384701 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8cf02fe5-ca8e-4a37-8503-f8051b00d467 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:40.385203 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8cf02fe5-ca8e-4a37-8503-f8051b00d467 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:40.386029 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8cf02fe5-ca8e-4a37-8503-f8051b00d467 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:40.386544 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-8cf02fe5-ca8e-4a37-8503-f8051b00d467 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:40.597123 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-8cf02fe5-ca8e-4a37-8503-f8051b00d467 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:41:40.606121 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-8cf02fe5-ca8e-4a37-8503-f8051b00d467 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4" status: 200 len: 1465 microversion: 2.1 time: 0.234480 Feb 19 02:41:40.606769 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 564/1120] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:41:40 2021] GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4 => generated 1465 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:41:40.799744 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 02:41:40.800554 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: Fri Feb 19 02:41:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 02:41:41.475886 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-e996838d-a5cf-4382-b53b-702d308435d4 req-1ff45483-be68-40f0-82ac-cb20e6d0316e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7935c2fe-742f-47d5-a02f-c4c72a29e7c4", "name": "network-vif-deleted", "tag": "fe990f66-c038-4176-b18a-30d887d98c87"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:41:41.477672 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:41:41.477672 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:41:41.486753 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-e996838d-a5cf-4382-b53b-702d308435d4 req-1ff45483-be68-40f0-82ac-cb20e6d0316e service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:41.487257 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-e996838d-a5cf-4382-b53b-702d308435d4 req-1ff45483-be68-40f0-82ac-cb20e6d0316e service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:41.505444 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-e996838d-a5cf-4382-b53b-702d308435d4 req-1ff45483-be68-40f0-82ac-cb20e6d0316e service nova] Creating event network-vif-deleted:fe990f66-c038-4176-b18a-30d887d98c87 for instance 7935c2fe-742f-47d5-a02f-c4c72a29e7c4 on hv-cinder-77642 Feb 19 02:41:41.510623 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-e996838d-a5cf-4382-b53b-702d308435d4 req-1ff45483-be68-40f0-82ac-cb20e6d0316e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039803 Feb 19 02:41:41.511269 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 557/1121] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:41:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:41:41.624390 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-9ee91242-0af5-40aa-9ff6-5ee918f7311b tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:41:41.625085 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-9ee91242-0af5-40aa-9ff6-5ee918f7311b tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: 7935c2fe-742f-47d5-a02f-c4c72a29e7c4] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:41:41.632871 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9ee91242-0af5-40aa-9ff6-5ee918f7311b tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:41.633389 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9ee91242-0af5-40aa-9ff6-5ee918f7311b tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:41.634397 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9ee91242-0af5-40aa-9ff6-5ee918f7311b tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:41.634870 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-9ee91242-0af5-40aa-9ff6-5ee918f7311b tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:41.780148 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-9ee91242-0af5-40aa-9ff6-5ee918f7311b tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:41:41.790152 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-9ee91242-0af5-40aa-9ff6-5ee918f7311b tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4" status: 200 len: 1225 microversion: 2.1 time: 0.169799 Feb 19 02:41:41.790811 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 565/1122] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:41:41 2021] GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4 => generated 1225 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:41:42.809169 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c860bd46-c973-4a9d-8d38-562169dfe882 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:41:42.809934 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c860bd46-c973-4a9d-8d38-562169dfe882 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: 7935c2fe-742f-47d5-a02f-c4c72a29e7c4] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:41:42.818441 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c860bd46-c973-4a9d-8d38-562169dfe882 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:42.818980 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c860bd46-c973-4a9d-8d38-562169dfe882 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:42.819807 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c860bd46-c973-4a9d-8d38-562169dfe882 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:42.820292 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c860bd46-c973-4a9d-8d38-562169dfe882 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:42.872483 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-c860bd46-c973-4a9d-8d38-562169dfe882 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] HTTP exception thrown: Instance 7935c2fe-742f-47d5-a02f-c4c72a29e7c4 could not be found. Feb 19 02:41:42.873063 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c860bd46-c973-4a9d-8d38-562169dfe882 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Returning 404 to user: Instance 7935c2fe-742f-47d5-a02f-c4c72a29e7c4 could not be found. {{(pid=98194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:41:42.873942 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c860bd46-c973-4a9d-8d38-562169dfe882 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4" status: 404 len: 111 microversion: 2.1 time: 0.069431 Feb 19 02:41:42.874579 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 558/1123] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:41:42 2021] GET /compute/v2.1/servers/7935c2fe-742f-47d5-a02f-c4c72a29e7c4 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 02:41:45.299151 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-5cdc09eb-209d-4a03-b439-dbedf05e79ca tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '.version_select at 0x7f217cde9bf8>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:41:45.771398 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-5cdc09eb-209d-4a03-b439-dbedf05e79ca tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: d1cba672-d813-45f4-ab87-e7ef1ce803e4] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:41:45.779271 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5cdc09eb-209d-4a03-b439-dbedf05e79ca tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:45.779773 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5cdc09eb-209d-4a03-b439-dbedf05e79ca tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:45.780619 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5cdc09eb-209d-4a03-b439-dbedf05e79ca tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:45.781110 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5cdc09eb-209d-4a03-b439-dbedf05e79ca tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:45.845981 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5cdc09eb-209d-4a03-b439-dbedf05e79ca tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Acquired lock "refresh_cache-d1cba672-d813-45f4-ab87-e7ef1ce803e4" {{(pid=98193) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:266}} Feb 19 02:41:47.778615 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-5cdc09eb-209d-4a03-b439-dbedf05e79ca tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: d1cba672-d813-45f4-ab87-e7ef1ce803e4] Building network info cache for instance {{(pid=98193) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1836}} Feb 19 02:41:47.789476 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-8818d0d4-a271-40ce-b738-3cf82135c39f req-f8dc4799-8375-433f-bf68-13c19a5deb83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1cba672-d813-45f4-ab87-e7ef1ce803e4", "tag": "74c7bb13-b661-4bc1-8c0c-b971254d0c61"}]} {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:41:47.791201 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:41:47.791201 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:41:47.800707 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-8818d0d4-a271-40ce-b738-3cf82135c39f req-f8dc4799-8375-433f-bf68-13c19a5deb83 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:47.801204 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-8818d0d4-a271-40ce-b738-3cf82135c39f req-f8dc4799-8375-433f-bf68-13c19a5deb83 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:47.819047 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-8818d0d4-a271-40ce-b738-3cf82135c39f req-f8dc4799-8375-433f-bf68-13c19a5deb83 service nova] Creating event network-changed:74c7bb13-b661-4bc1-8c0c-b971254d0c61 for instance d1cba672-d813-45f4-ab87-e7ef1ce803e4 on hv-cinder-77642 Feb 19 02:41:47.824451 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-8818d0d4-a271-40ce-b738-3cf82135c39f req-f8dc4799-8375-433f-bf68-13c19a5deb83 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038978 Feb 19 02:41:47.825126 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 559/1124] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:41:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:41:49.193525 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.network.neutron [None req-5cdc09eb-209d-4a03-b439-dbedf05e79ca tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: d1cba672-d813-45f4-ab87-e7ef1ce803e4] Updating instance_info_cache with network_info: [{"id": "74c7bb13-b661-4bc1-8c0c-b971254d0c61", "address": "fa:16:3e:b6:c6:e8", "network": {"id": "d7a3d9c7-d762-4eea-968f-4f012d4c747a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1263351507-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3b0847ee05c643e981b009b8bc77c1aa", "mtu": 1450, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, "devname": "tap74c7bb13-b6", "ovs_interfaceid": "74c7bb13-b661-4bc1-8c0c-b971254d0c61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {}}] {{(pid=98193) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Feb 19 02:41:49.205109 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-5cdc09eb-209d-4a03-b439-dbedf05e79ca tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Releasing lock "refresh_cache-d1cba672-d813-45f4-ab87-e7ef1ce803e4" {{(pid=98193) lock /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:282}} Feb 19 02:41:49.206615 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-5cdc09eb-209d-4a03-b439-dbedf05e79ca tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "DELETE /compute/v2.1/os-floating-ips/7dccece1-bdb8-4d37-a5d7-0e427abc2265" status: 202 len: 0 microversion: 2.1 time: 3.910885 Feb 19 02:41:49.207266 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 566/1125] 10.222.0.44 () {58 vars in 1253 bytes} [Fri Feb 19 02:41:45 2021] DELETE /compute/v2.1/os-floating-ips/7dccece1-bdb8-4d37-a5d7-0e427abc2265 => generated 0 bytes in 3913 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:41:49.217712 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d10b47fb-c6bf-4693-b8cb-f8cb0b5c49df tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:41:49.218393 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d10b47fb-c6bf-4693-b8cb-f8cb0b5c49df tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: d1cba672-d813-45f4-ab87-e7ef1ce803e4] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:41:49.227247 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d10b47fb-c6bf-4693-b8cb-f8cb0b5c49df tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:49.227755 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d10b47fb-c6bf-4693-b8cb-f8cb0b5c49df tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:49.228600 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d10b47fb-c6bf-4693-b8cb-f8cb0b5c49df tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:49.229090 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d10b47fb-c6bf-4693-b8cb-f8cb0b5c49df tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:49.296011 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d10b47fb-c6bf-4693-b8cb-f8cb0b5c49df tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: d1cba672-d813-45f4-ab87-e7ef1ce803e4] Going to try to terminate instance {{(pid=98194) delete /opt/stack/nova/nova/compute/api.py:2540}} Feb 19 02:41:49.560387 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d10b47fb-c6bf-4693-b8cb-f8cb0b5c49df tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4" status: 204 len: 0 microversion: 2.1 time: 0.347531 Feb 19 02:41:49.561152 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 560/1126] 10.222.0.44 () {58 vars in 1229 bytes} [Fri Feb 19 02:41:49 2021] DELETE /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 19 02:41:49.570550 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c89f3032-97cb-4f3f-afc4-02584d06860d tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:41:49.571227 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c89f3032-97cb-4f3f-afc4-02584d06860d tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: d1cba672-d813-45f4-ab87-e7ef1ce803e4] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:41:49.579495 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c89f3032-97cb-4f3f-afc4-02584d06860d tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:49.580401 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c89f3032-97cb-4f3f-afc4-02584d06860d tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:49.581815 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c89f3032-97cb-4f3f-afc4-02584d06860d tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:49.582307 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c89f3032-97cb-4f3f-afc4-02584d06860d tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:49.807720 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-c89f3032-97cb-4f3f-afc4-02584d06860d tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98193) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:41:49.816654 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c89f3032-97cb-4f3f-afc4-02584d06860d tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4" status: 200 len: 1463 microversion: 2.1 time: 0.250257 Feb 19 02:41:49.817275 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 567/1127] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:41:49 2021] GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4 => generated 1463 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:41:50.836162 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-27fc3041-621e-459d-901a-c0fcea3f0410 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:41:50.836921 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-27fc3041-621e-459d-901a-c0fcea3f0410 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: d1cba672-d813-45f4-ab87-e7ef1ce803e4] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:41:50.844910 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-27fc3041-621e-459d-901a-c0fcea3f0410 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:50.845410 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-27fc3041-621e-459d-901a-c0fcea3f0410 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:50.846235 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-27fc3041-621e-459d-901a-c0fcea3f0410 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:50.846746 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-27fc3041-621e-459d-901a-c0fcea3f0410 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:51.061035 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-27fc3041-621e-459d-901a-c0fcea3f0410 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:41:51.070036 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-27fc3041-621e-459d-901a-c0fcea3f0410 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4" status: 200 len: 1463 microversion: 2.1 time: 0.238503 Feb 19 02:41:51.070680 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 561/1128] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:41:50 2021] GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4 => generated 1463 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:41:51.616208 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-922baa7b-f29f-432a-8915-fedf4dd6c05d req-039cf3e7-a7d9-4e55-9ac9-f7f8c01f4430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1cba672-d813-45f4-ab87-e7ef1ce803e4", "name": "network-vif-unplugged", "status": "completed", "tag": "74c7bb13-b661-4bc1-8c0c-b971254d0c61"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:41:51.618381 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:41:51.618381 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:41:51.628259 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-922baa7b-f29f-432a-8915-fedf4dd6c05d req-039cf3e7-a7d9-4e55-9ac9-f7f8c01f4430 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:51.629047 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-922baa7b-f29f-432a-8915-fedf4dd6c05d req-039cf3e7-a7d9-4e55-9ac9-f7f8c01f4430 service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:51.650290 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-922baa7b-f29f-432a-8915-fedf4dd6c05d req-039cf3e7-a7d9-4e55-9ac9-f7f8c01f4430 service nova] Creating event network-vif-unplugged:74c7bb13-b661-4bc1-8c0c-b971254d0c61 for instance d1cba672-d813-45f4-ab87-e7ef1ce803e4 on hv-cinder-77642 Feb 19 02:41:51.655538 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-922baa7b-f29f-432a-8915-fedf4dd6c05d req-039cf3e7-a7d9-4e55-9ac9-f7f8c01f4430 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044319 Feb 19 02:41:51.656189 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 568/1129] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:41:51 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:41:52.088494 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-344c2f7c-2b2b-4816-9686-c41780a7cc15 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:41:52.089154 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-344c2f7c-2b2b-4816-9686-c41780a7cc15 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: d1cba672-d813-45f4-ab87-e7ef1ce803e4] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:41:52.097608 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-344c2f7c-2b2b-4816-9686-c41780a7cc15 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:52.098107 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-344c2f7c-2b2b-4816-9686-c41780a7cc15 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:52.098962 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-344c2f7c-2b2b-4816-9686-c41780a7cc15 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:52.099447 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-344c2f7c-2b2b-4816-9686-c41780a7cc15 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:52.309903 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-344c2f7c-2b2b-4816-9686-c41780a7cc15 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:41:52.319071 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-344c2f7c-2b2b-4816-9686-c41780a7cc15 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4" status: 200 len: 1463 microversion: 2.1 time: 0.234552 Feb 19 02:41:52.319691 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 562/1130] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:41:52 2021] GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4 => generated 1463 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:41:52.945925 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [req-9290d706-02ee-4c1d-90f0-b210d793849b req-83f9f0dc-89b4-4c52-9632-127d71349a6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1cba672-d813-45f4-ab87-e7ef1ce803e4", "name": "network-vif-deleted", "tag": "74c7bb13-b661-4bc1-8c0c-b971254d0c61"}]} {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:510}} Feb 19 02:41:52.947730 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: /usr/local/lib/python3.6/dist-packages/oslo_policy/policy.py:1053: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 19 02:41:52.947730 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: warnings.warn(msg) Feb 19 02:41:52.959111 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-9290d706-02ee-4c1d-90f0-b210d793849b req-83f9f0dc-89b4-4c52-9632-127d71349a6b service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:52.959619 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [req-9290d706-02ee-4c1d-90f0-b210d793849b req-83f9f0dc-89b4-4c52-9632-127d71349a6b service nova] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:52.980030 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.compute.server_external_events [req-9290d706-02ee-4c1d-90f0-b210d793849b req-83f9f0dc-89b4-4c52-9632-127d71349a6b service nova] Creating event network-vif-deleted:74c7bb13-b661-4bc1-8c0c-b971254d0c61 for instance d1cba672-d813-45f4-ab87-e7ef1ce803e4 on hv-cinder-77642 Feb 19 02:41:52.984987 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [req-9290d706-02ee-4c1d-90f0-b210d793849b req-83f9f0dc-89b4-4c52-9632-127d71349a6b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045446 Feb 19 02:41:52.985868 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 569/1131] 10.222.0.44 () {64 vars in 1308 bytes} [Fri Feb 19 02:41:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 19 02:41:53.338137 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-025de471-b39d-45fb-8359-7a89a92e9a32 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:41:53.338817 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-025de471-b39d-45fb-8359-7a89a92e9a32 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: d1cba672-d813-45f4-ab87-e7ef1ce803e4] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:41:53.347305 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-025de471-b39d-45fb-8359-7a89a92e9a32 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:53.347817 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-025de471-b39d-45fb-8359-7a89a92e9a32 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:53.348674 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-025de471-b39d-45fb-8359-7a89a92e9a32 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:53.349165 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-025de471-b39d-45fb-8359-7a89a92e9a32 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:53.428712 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-025de471-b39d-45fb-8359-7a89a92e9a32 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:53.429214 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-025de471-b39d-45fb-8359-7a89a92e9a32 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:53.429713 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.objects.instance [None req-025de471-b39d-45fb-8359-7a89a92e9a32 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lazy-loading 'fault' on Instance uuid d1cba672-d813-45f4-ab87-e7ef1ce803e4 {{(pid=98194) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1101}} Feb 19 02:41:53.493153 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.policy [None req-025de471-b39d-45fb-8359-7a89a92e9a32 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4372723bc6674cb4972c619b77ae55db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0847ee05c643e981b009b8bc77c1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98194) authorize /opt/stack/nova/nova/policy.py:202}} Feb 19 02:41:53.501912 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-025de471-b39d-45fb-8359-7a89a92e9a32 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4" status: 200 len: 1229 microversion: 2.1 time: 0.167909 Feb 19 02:41:53.502505 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 563/1132] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:41:53 2021] GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4 => generated 1229 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 19 02:41:54.522326 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d09b74ee-4d85-4b8f-87f1-6e692268d959 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:41:54.523170 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d09b74ee-4d85-4b8f-87f1-6e692268d959 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: d1cba672-d813-45f4-ab87-e7ef1ce803e4] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:41:54.531292 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d09b74ee-4d85-4b8f-87f1-6e692268d959 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:54.531806 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d09b74ee-4d85-4b8f-87f1-6e692268d959 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:54.532643 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d09b74ee-4d85-4b8f-87f1-6e692268d959 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:54.533142 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d09b74ee-4d85-4b8f-87f1-6e692268d959 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:54.588889 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-d09b74ee-4d85-4b8f-87f1-6e692268d959 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] HTTP exception thrown: Instance d1cba672-d813-45f4-ab87-e7ef1ce803e4 could not be found. Feb 19 02:41:54.589550 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d09b74ee-4d85-4b8f-87f1-6e692268d959 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Returning 404 to user: Instance d1cba672-d813-45f4-ab87-e7ef1ce803e4 could not be found. {{(pid=98193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:41:54.590518 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d09b74ee-4d85-4b8f-87f1-6e692268d959 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4" status: 404 len: 111 microversion: 2.1 time: 0.073265 Feb 19 02:41:54.591115 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 570/1133] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:41:54 2021] GET /compute/v2.1/servers/d1cba672-d813-45f4-ab87-e7ef1ce803e4 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 02:41:54.600302 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d5cf8aa1-cd70-4c17-b885-8ae25f361298 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '.version_select at 0x7f217c172268>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:41:56.196151 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d5cf8aa1-cd70-4c17-b885-8ae25f361298 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "DELETE /compute/v2.1/os-floating-ips/b4e671aa-7099-4627-9a63-7b5f2a3a87db" status: 202 len: 0 microversion: 2.1 time: 1.600170 Feb 19 02:41:56.196789 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 564/1134] 10.222.0.44 () {58 vars in 1253 bytes} [Fri Feb 19 02:41:54 2021] DELETE /compute/v2.1/os-floating-ips/b4e671aa-7099-4627-9a63-7b5f2a3a87db => generated 0 bytes in 1602 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:41:56.205645 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c4c63336-5691-4360-9d92-acaadd607357 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:41:56.206782 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-c4c63336-5691-4360-9d92-acaadd607357 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3] Fetching instance by UUID {{(pid=98193) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:41:56.215078 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c4c63336-5691-4360-9d92-acaadd607357 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:56.215590 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c4c63336-5691-4360-9d92-acaadd607357 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:56.216452 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c4c63336-5691-4360-9d92-acaadd607357 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:56.216948 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-c4c63336-5691-4360-9d92-acaadd607357 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98193) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:56.270105 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-c4c63336-5691-4360-9d92-acaadd607357 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] HTTP exception thrown: Instance b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3 could not be found. Feb 19 02:41:56.270853 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-c4c63336-5691-4360-9d92-acaadd607357 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Returning 404 to user: Instance b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3 could not be found. {{(pid=98193) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:41:56.271760 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-c4c63336-5691-4360-9d92-acaadd607357 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3" status: 404 len: 111 microversion: 2.1 time: 0.070439 Feb 19 02:41:56.272358 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 571/1135] 10.222.0.44 () {58 vars in 1229 bytes} [Fri Feb 19 02:41:56 2021] DELETE /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 02:41:56.281016 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d05a4866-3782-4be9-91eb-8280af08690a tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:41:56.281675 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.compute.api [None req-d05a4866-3782-4be9-91eb-8280af08690a tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] [instance: b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3] Fetching instance by UUID {{(pid=98194) get /opt/stack/nova/nova/compute/api.py:2792}} Feb 19 02:41:56.289380 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d05a4866-3782-4be9-91eb-8280af08690a tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:56.289950 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d05a4866-3782-4be9-91eb-8280af08690a tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:56.290799 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d05a4866-3782-4be9-91eb-8280af08690a tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:359}} Feb 19 02:41:56.291282 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG oslo_concurrency.lockutils [None req-d05a4866-3782-4be9-91eb-8280af08690a tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Lock "ce81d1bb-b8a9-47c7-a18f-1a9927c9b0e8" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=98194) inner /usr/local/lib/python3.6/dist-packages/oslo_concurrency/lockutils.py:371}} Feb 19 02:41:56.344515 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.wsgi [None req-d05a4866-3782-4be9-91eb-8280af08690a tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] HTTP exception thrown: Instance b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3 could not be found. Feb 19 02:41:56.345169 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-d05a4866-3782-4be9-91eb-8280af08690a tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Returning 404 to user: Instance b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3 could not be found. {{(pid=98194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:926}} Feb 19 02:41:56.346066 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-d05a4866-3782-4be9-91eb-8280af08690a tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3" status: 404 len: 111 microversion: 2.1 time: 0.069107 Feb 19 02:41:56.346710 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 565/1136] 10.222.0.44 () {58 vars in 1226 bytes} [Fri Feb 19 02:41:56 2021] GET /compute/v2.1/servers/b664eceb-b7d1-4ad4-9894-cd7d69f1d3c3 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 19 02:41:57.592184 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-1555a34a-ef26-4d24-949e-f87fd9e9cbb0 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '.version_select at 0x7f217d61eea0>' {{(pid=98193) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:41:57.838098 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-1555a34a-ef26-4d24-949e-f87fd9e9cbb0 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "DELETE /compute/v2.1/os-security-groups/622b6944-4cf6-4d6d-99db-d5660c7b5ae1" status: 202 len: 0 microversion: 2.1 time: 0.249798 Feb 19 02:41:57.838783 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98193|app: 0|req: 572/1137] 10.222.0.44 () {58 vars in 1262 bytes} [Fri Feb 19 02:41:57 2021] DELETE /compute/v2.1/os-security-groups/622b6944-4cf6-4d6d-99db-d5660c7b5ae1 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:41:57.848467 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: DEBUG nova.api.openstack.wsgi [None req-45cee568-dcd1-4736-81ef-4350421d75e3 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] Calling method '.version_select at 0x7f217d739ea0>' {{(pid=98194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 19 02:41:57.867738 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO nova.api.openstack.requestlog [None req-45cee568-dcd1-4736-81ef-4350421d75e3 tempest-TestVolumeBootPattern-331106713 tempest-TestVolumeBootPattern-331106713-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-483956370" status: 202 len: 0 microversion: 2.1 time: 0.024222 Feb 19 02:41:57.868384 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: [pid: 98194|app: 0|req: 566/1138] 10.222.0.44 () {58 vars in 1250 bytes} [Fri Feb 19 02:41:57 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-483956370 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 19 02:42:50.273022 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 02:42:50.273523 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: Fri Feb 19 02:42:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 02:44:39.590377 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 02:44:39.590944 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: Fri Feb 19 02:44:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 02:44:54.413060 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 02:44:54.413522 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: Fri Feb 19 02:44:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 02:44:58.758331 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 02:44:58.758883 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: Fri Feb 19 02:44:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 02:45:00.817273 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 02:45:00.817714 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: Fri Feb 19 02:45:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 02:45:09.835877 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 02:45:09.836384 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: Fri Feb 19 02:45:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 19 02:46:10.289352 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 19 02:46:10.289831 dv-cinder-776422-2-iscsi devstack@n-api.service[98192]: Fri Feb 19 02:46:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!